-- Logs begin at Mon 2022-07-25 05:02:53 UTC, end at Mon 2022-07-25 06:19:34 UTC. -- Jul 25 05:50:32.015661 dv-cinder-848418-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 05:50:32.026025 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 05:50:32.027346 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 05:50:32 2022] *** Jul 25 05:50:32.027346 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 05:50:32.027346 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 05:50:32.027346 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: nodename: dv-cinder-848418-2-iscsi Jul 25 05:50:32.027346 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: machine: x86_64 Jul 25 05:50:32.027346 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: clock source: unix Jul 25 05:50:32.027346 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: pcre jit disabled Jul 25 05:50:32.027346 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: detected number of CPU cores: 4 Jul 25 05:50:32.027346 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: current working directory: / Jul 25 05:50:32.027346 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: detected binary path: /usr/bin/uwsgi-core Jul 25 05:50:32.028059 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: your processes number limit is 47680 Jul 25 05:50:32.028059 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: your memory page size is 4096 bytes Jul 25 05:50:32.028059 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: detected max file descriptor number: 2048 Jul 25 05:50:32.028059 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: lock engine: pthread robust mutexes Jul 25 05:50:32.028059 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: thunder lock: enabled Jul 25 05:50:32.028059 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 05:50:32.028059 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 05:50:32.072350 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: Python main interpreter initialized at 0x55fe91a859c0 Jul 25 05:50:32.072350 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: python threads support enabled Jul 25 05:50:32.072350 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: your server socket listen backlog is limited to 100 connections Jul 25 05:50:32.072350 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: your mercy for graceful operations on workers is 90 seconds Jul 25 05:50:32.072691 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 05:50:32.072790 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: *** Operational MODE: preforking *** Jul 25 05:50:32.073002 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: *** uWSGI is running in multiple interpreter mode *** Jul 25 05:50:32.073002 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: spawned uWSGI master process (pid: 109998) Jul 25 05:50:32.073195 dv-cinder-848418-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 05:50:32.076049 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: spawned uWSGI worker 1 (pid: 109999, cores: 1) Jul 25 05:50:32.076049 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: spawned uWSGI worker 2 (pid: 110000, cores: 1) Jul 25 05:50:32.076049 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 05:50:32.732507 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:50:32.733113 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:50:33.858441 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:50:33.858441 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: from cryptography.utils import int_from_bytes Jul 25 05:50:33.859015 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:50:33.859015 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: from cryptography.utils import int_from_bytes Jul 25 05:50:33.859420 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:50:33.859420 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: from cryptography.utils import int_from_bytes Jul 25 05:50:33.859598 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:50:33.859598 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: from cryptography.utils import int_from_bytes Jul 25 05:50:36.339967 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:50:36.340553 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:50:36.340924 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:50:36.341023 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:50:36.341115 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:50:36.341195 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:50:36.341272 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:50:36.341356 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:50:36.341435 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:50:36.341521 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:50:36.341742 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.341904 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.342070 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.342231 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.342397 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.342551 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.342720 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.342869 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.343053 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.343201 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.343370 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.343512 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.343693 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.343830 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.344018 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.344172 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.344369 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.344503 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.344631 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.344764 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.344950 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.345117 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.345278 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848418-2-iscsi {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.345396 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848418-2-iscsi {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.345601 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.345757 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.345896 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.346011 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.346207 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.346320 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.346529 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.346641 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.346839 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.346945 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.347169 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.347261 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.347472 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.347569 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.347975 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.348086 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.348433 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.348557 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.348740 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.348845 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.349052 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.349157 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.349393 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.349488 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.349698 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.349790 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.350008 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.350106 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.350329 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.350417 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.350634 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.350727 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.350955 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.351051 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.351261 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.351364 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.351686 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848418-2-iscsi {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.351808 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848418-2-iscsi {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.352096 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.352278 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.352410 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.352634 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.352735 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.352884 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.353135 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.353300 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.353453 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.353600 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.353760 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.353905 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.354077 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.354234 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.354406 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.354563 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.354709 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.354856 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.355043 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.355190 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.355366 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.355522 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.355689 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.355878 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.356055 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.356165 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.356340 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.356465 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.356652 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.356742 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.356965 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.357063 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.357287 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.357387 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.357594 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.357691 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.357904 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.358005 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.358154 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.358242 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.358459 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.358563 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.358782 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.358874 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.359101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.359190 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.359424 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.359531 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.359692 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.359789 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.359934 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.360026 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.360267 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.360388 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.360580 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.360738 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.360885 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.361026 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.361174 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.361309 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.361475 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.361619 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.361784 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.361935 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.362073 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.362206 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.362381 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.362524 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.362687 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.362829 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.362990 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.363141 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.363290 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.363424 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.363610 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.363761 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.363929 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.364073 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.364266 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.364403 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.364572 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.364724 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.364973 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.365124 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.365271 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.365414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.365550 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.365684 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.365848 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.366007 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.366167 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.366308 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.366474 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.366614 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.366825 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.366982 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.367129 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.367925 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.368245 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.368446 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.368589 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.368742 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.368892 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.369030 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.369189 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.369338 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.369487 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.369625 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.369760 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.369909 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.370045 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.370179 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.370322 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.370458 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.370599 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.370743 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.370889 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.371026 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.371174 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.371310 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.371445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.371585 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.371736 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.371872 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.372093 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.372258 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.372394 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.372528 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.372674 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.372810 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.372957 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.373095 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.373230 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.373364 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.373498 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.373661 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.373797 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.373931 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.374064 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.374199 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.374333 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.374479 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.374621 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.374755 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.374896 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.375038 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.375173 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.375319 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.375465 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.375600 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.375733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.375866 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.376013 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.376229 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.376384 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.376529 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.376672 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.376807 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.376942 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.377085 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.377236 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.377372 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.377505 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.377639 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.377820 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.377976 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.378112 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.378259 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.378430 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.378574 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.378738 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.378894 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.379042 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.379186 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.379353 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.379497 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.379654 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.379807 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.379944 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.380077 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.380285 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.380432 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.380582 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.380718 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.380883 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.381026 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.381171 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.381305 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.381478 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.381624 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.381781 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.381923 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.382089 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.382237 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.382385 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.382533 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.382669 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.382814 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.383583 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.383829 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.384032 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.384217 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.384369 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.384514 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.384651 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.384795 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.384943 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.385086 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.385223 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.385357 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.385498 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.385643 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:50:36.385791 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.385933 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.386069 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.386204 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.386338 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.386523 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.386667 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.386844 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.386998 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.387183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.387336 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.387520 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.387673 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.387843 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.387987 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.388182 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.388341 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.388503 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.388646 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.388831 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.388973 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.389145 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.389295 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.389457 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.389608 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.389770 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.389912 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.390084 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.390237 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.390394 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.390537 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.390720 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.390863 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.391037 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.391186 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.391356 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.391499 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.391669 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.391812 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.391987 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.392164 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.392321 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.392464 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.392649 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.392793 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.393009 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.393147 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.393312 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.393451 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.393594 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.393741 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.393920 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.394070 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.394238 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.394380 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.394558 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.394699 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.394873 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.395016 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.395186 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.395326 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.395496 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.395648 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.395792 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.395934 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.396170 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.396331 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.396469 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.396611 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.396754 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.396889 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.397072 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.397218 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.397389 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.397540 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.397686 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.397822 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.398001 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.398143 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.398315 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.398491 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.398691 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.398921 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.399112 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.399252 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.399397 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.399547 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.399685 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.399838 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.399975 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.400146 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.400291 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.400447 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.400584 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.400720 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.400854 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.400988 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.401136 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.401272 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.401408 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.401543 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.401689 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.401824 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.401972 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.402117 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.402252 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.402387 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.402563 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.402713 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.402891 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.403041 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.403200 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.403343 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.403535 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.403687 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.403831 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.403974 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.404162 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.404307 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.404466 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.404627 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.404764 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.404899 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.405076 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.405220 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.405390 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.405553 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.405692 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.405827 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.405995 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.406137 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.406319 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.406471 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.406632 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.406775 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.406939 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.407082 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.407251 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.407402 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.407549 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.407682 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.407851 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.407994 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.408193 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.408338 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.408508 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.408660 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.408824 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.408966 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.409135 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.409285 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.409458 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.409612 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.409774 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.409924 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.410073 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.410216 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.410388 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.410538 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.410711 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.410862 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.411041 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.411184 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.411349 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.411502 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.411671 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.411821 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.411995 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.412163 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.412343 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.412486 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.412637 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.412783 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.412953 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.413096 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.413251 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.413396 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.413543 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.413688 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.413845 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.413989 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.414216 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.414439 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.414667 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.414860 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.415011 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.415149 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.415286 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.415433 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.415578 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.415724 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.415868 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.416012 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.416187 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.416331 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.416478 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.416615 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.416750 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.416884 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.417019 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.417154 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.417303 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.417447 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.417594 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.417729 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.417871 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.418007 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.418150 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.418288 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.418430 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.418574 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.418708 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.418852 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.419025 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.419169 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.419352 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.419520 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.419657 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.419806 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.419974 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.420150 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.420295 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.420430 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.420613 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.420769 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.420918 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.421055 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.421228 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.421382 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.421551 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.421771 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.421910 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.422047 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.422182 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.422324 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.422468 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.422613 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.422794 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.422945 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.423107 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.423251 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.423419 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.423558 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.423718 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.423860 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.424038 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.424228 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.424409 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.424553 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.424724 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.424864 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.425045 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.425188 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.425359 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.425515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.425658 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.426069 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.426253 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.426394 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.426565 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.426708 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.426874 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.427014 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.427185 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.427336 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.427501 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.427646 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.427797 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.427931 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.428136 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.428296 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.428434 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.428569 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.428757 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.428905 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.429065 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.429214 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.429381 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.429522 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.430202 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.430476 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.430719 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.430925 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.431066 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.431201 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.431336 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.431470 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.431604 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.431753 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.431891 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.432025 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.432186 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.432348 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.432495 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.432638 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.432786 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.432929 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.433069 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.433209 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.433357 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.433524 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.433674 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.433827 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.433971 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.434120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.434295 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.434440 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.434581 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.434722 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.434869 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.435021 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.435170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.435319 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.435461 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.435613 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.435755 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.435912 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.436055 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.436288 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.436433 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.436575 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.436715 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.436869 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.437012 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.437153 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.437293 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.437434 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.437581 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.437736 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.437886 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.438052 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.438212 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.438401 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.438542 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.438691 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.438840 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.438994 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.439136 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.439276 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.439425 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.439574 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.439715 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.439855 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.440003 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.440192 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.440364 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.440508 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.440649 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.440845 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.441001 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.441153 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.441308 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.441452 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.441602 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.441743 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.441884 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.442060 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.442218 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.442363 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.442501 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.442671 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.442820 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.442969 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.443118 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.443284 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.443443 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.443592 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.443733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.443882 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.444035 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.444221 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.444370 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.444522 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.444665 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.444815 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.444957 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.445111 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.445254 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.446002 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.446245 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.446506 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.446664 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.446822 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.446964 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.447105 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.447260 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.447402 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.447544 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.447684 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.447832 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.447832 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.448129 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.448284 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.448435 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.448675 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.448834 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.449080 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.449237 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.449380 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.449521 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.449662 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.449802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.449950 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.450101 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.450244 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.450392 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.450541 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.450770 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.450927 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.451071 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.451219 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.451362 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.451512 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.451662 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.451805 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.451954 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.452096 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.452315 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.452459 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.452599 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.452758 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.452901 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.453041 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.453189 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.453338 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.453480 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.453620 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.453761 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.453918 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.454061 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.454202 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.454353 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.454503 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.454657 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.454806 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.454949 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.455097 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.455238 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.455379 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.455519 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.455673 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.455864 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.456015 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.456173 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.456332 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.456475 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.456635 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.456785 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.456935 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.457078 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.457226 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.457377 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.457519 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.457660 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.457801 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.457948 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.458091 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.458242 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.458394 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.458611 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.458765 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.458908 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.459049 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.459198 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.459350 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.459492 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.459633 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.459774 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.459922 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.460072 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.460281 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.460512 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.460658 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.460807 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.460999 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.461214 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.461457 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.461666 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.461822 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.461966 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.461966 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.462247 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.462388 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.462528 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.462679 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.462820 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.462969 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.463119 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.463263 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.463403 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.463550 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.463700 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.463855 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.463998 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.464165 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.464335 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.464490 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.464641 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.464790 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.464932 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.465072 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.465212 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.465352 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.465507 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.465649 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.465790 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.465930 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.466070 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.466210 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.466369 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.466512 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.466652 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.466800 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.466942 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.467092 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.467247 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.467389 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.467531 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.467671 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.467811 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.467959 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.468102 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.468291 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.468443 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.468587 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.468735 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.468886 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.469028 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.469169 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.469317 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.469458 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.469600 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.469754 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.469897 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.470037 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.470188 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.470335 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.470477 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.470631 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.470781 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.470922 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.471063 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.471210 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.471365 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.471508 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.471661 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.471803 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.471944 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.472104 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.472293 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.472436 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.472584 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.472734 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.472885 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.473027 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.473177 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.473319 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.473459 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.473599 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.473740 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.473891 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.474040 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.474182 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.474333 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.474475 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.474615 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.474830 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.474975 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.475116 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.475256 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.475396 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.475544 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.475699 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.475852 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.475993 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.476182 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.476341 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.476484 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.477162 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.477368 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.477589 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.477844 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.477844 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.478156 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.478156 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.478436 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.478588 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.478730 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.478870 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.479020 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.479162 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.479304 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.479444 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.479591 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.479741 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.479895 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.480039 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.480219 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.480365 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.480516 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.480664 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.480820 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.480974 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.481117 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.481257 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.481397 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.481537 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.481687 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.481829 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.481969 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.482109 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.482250 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.482408 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.482551 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.482698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.482848 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.482990 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.483131 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.483281 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.483424 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.483571 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.483720 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.483863 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.484003 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.484222 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.484375 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.484516 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.484665 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.484818 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.484960 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.485109 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.485258 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.485409 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.485551 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.485692 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.485831 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.485980 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.486132 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.486273 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.486414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.486555 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.486709 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.486852 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.486994 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.487142 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.487283 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.487433 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.487583 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.487725 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.487866 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.488016 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.488179 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.488328 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.488485 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.488629 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.488769 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.488916 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.489059 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.489208 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.489356 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.489499 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.489639 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.489779 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.489937 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.490092 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.490235 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.490376 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.490516 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.490712 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.490870 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.491021 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.491165 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.491313 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.491455 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.491621 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.491780 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.491935 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.492078 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.492828 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.493053 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.493287 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.493536 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.493727 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.493872 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.494014 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.494162 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.494337 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.494499 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.494655 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.494804 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.494948 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.495089 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.495229 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.495379 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.495529 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.495678 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.495856 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.496005 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.496173 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.496333 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.496485 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.496639 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.496780 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.496930 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.497080 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.497237 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.497380 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.497521 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.497691 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.497847 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.497999 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.498140 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.498312 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.498462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.498702 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.498850 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.499039 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.499188 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.499352 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.499501 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.499725 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.499873 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.500053 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.500260 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.500406 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.500553 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.500713 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.500869 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.501021 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.501162 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.501314 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.501542 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.501700 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.501844 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.501985 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.502128 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.502277 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.502419 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.502560 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.502717 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.502860 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.503014 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.503158 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.503300 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.503449 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.503563 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.503741 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.503844 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.504056 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.504176 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.504406 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.504494 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.504730 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.504845 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.505059 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.505162 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.505433 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.505529 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.505757 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.505845 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.506083 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.506169 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.506393 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.506479 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.506702 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.506789 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.507017 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.507104 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.507325 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.507425 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.507631 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.507729 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.507980 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.508070 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.508317 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.508456 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.508632 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.508723 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.508944 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.509046 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.509255 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.509351 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.509561 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.509648 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.509867 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.509966 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.510190 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.510295 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.510491 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.510584 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.510815 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.510908 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.511124 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.511219 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.511449 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.511533 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.511766 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.511858 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.512070 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.512201 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.512421 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.512508 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.512731 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.512815 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.513035 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.513129 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.513343 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.513443 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.513651 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.513749 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.513956 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.514042 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.514265 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.514351 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.514598 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.514690 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.514907 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.514995 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.515234 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.515321 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.515555 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.515639 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.515885 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.515971 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.516225 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.516314 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.516542 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.516640 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.516864 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.516951 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.517187 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.517274 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.517493 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.517587 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.517804 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.517903 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.518115 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.518200 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.518421 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.518521 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.518728 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.518813 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.519036 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.519129 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.519345 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.519439 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.519651 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.519736 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.519958 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.520043 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.520292 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.520389 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.520599 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.520685 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.520906 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.520991 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.521231 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.521318 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.521539 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.521625 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.521844 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.521928 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.522152 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.522239 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.522457 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.522552 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.522764 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.522849 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.523078 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.523166 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.523417 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.523547 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.523755 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.523902 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.524086 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.524354 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.524442 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.524694 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.524789 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.525011 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.525106 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.525345 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.525433 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.525669 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.525762 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.525988 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.526074 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.526305 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.526399 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.526624 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.526709 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.526939 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.527025 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.527256 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.527341 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.527570 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.527664 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.527884 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.527990 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.528217 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.528306 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.528536 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.528635 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.528853 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.528946 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.529176 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.529377 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.529704 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.529805 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.530021 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.530105 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.530340 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.530439 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.530655 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.530754 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.530969 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.531054 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.531283 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.531370 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.531597 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.531684 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.531909 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.531995 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.532247 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.532337 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.532562 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.532651 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.532881 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.532968 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.533202 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.533288 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.533526 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.533613 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.533859 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.533964 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.534173 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.534268 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.534491 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.534579 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.534809 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.534902 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.535123 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.535220 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.535441 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.535527 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.535787 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.535871 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.536097 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.536227 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.536430 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.536521 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.536749 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.536847 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.537064 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.537153 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.537378 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.537455 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.537691 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.537766 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.538005 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.538110 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.538319 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.538411 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.538628 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.538722 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.538942 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.539026 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.539777 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.539917 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.540095 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.540339 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.540489 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.540665 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.540751 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.541000 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.541085 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.541343 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.541431 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.541671 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.541756 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.541986 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.542078 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.542307 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.542508 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.542630 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.542826 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.543161 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.543253 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.543487 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.543578 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.543810 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.543918 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.544151 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.544264 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.544472 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.544559 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.544794 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.544878 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.545101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.545196 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.545410 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.545496 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.545732 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.545817 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.546043 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.546137 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.546351 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.546446 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.546663 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.546748 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.546974 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.547061 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.547278 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.547364 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.547602 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.547687 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.547911 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.548010 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.548264 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.548490 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.548578 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.548839 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.549109 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.549196 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.549465 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.549551 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.549790 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.549887 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.550112 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.550206 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.550423 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.550508 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.551019 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.551118 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.551330 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.551415 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.551640 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.551726 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.551958 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.552053 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.552337 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.552451 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.552600 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.552693 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.552909 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.552997 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.553216 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.553300 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.553524 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.553609 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.553831 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.553917 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.554147 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.554258 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.554451 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.554548 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.555325 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.555464 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.555643 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.555732 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.555975 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.556060 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.556313 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.556403 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.556625 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.556727 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.556929 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.557022 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.557238 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.557324 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.557545 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.557630 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.557849 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.557948 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.558157 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.558256 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.558462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.558556 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.558772 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.558868 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.559078 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.559166 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.559389 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.559475 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.559695 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.559790 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.560006 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.560092 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.560339 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.560436 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.560656 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.560752 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.560983 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.561067 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.561289 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.561375 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.561609 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.561703 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.561916 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.562000 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.562237 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.562324 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.562553 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.562650 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.562862 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.562949 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.563178 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.563262 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.563498 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.563592 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.563849 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.564038 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.564191 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.564423 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.564740 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.564826 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.565075 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.565160 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.565403 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.565501 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.565715 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.565800 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.566025 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.566118 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.566341 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.566440 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.566665 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.566749 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.566976 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.567060 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.567291 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.567385 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.567603 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.567689 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.567918 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.568003 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.568254 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.568344 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.568569 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.568654 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.568881 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.568967 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.569195 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.569283 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.569507 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.569601 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.569820 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.569913 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.570130 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.570216 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.570473 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.570584 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.570777 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.570873 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.571091 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.571176 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.571403 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.571488 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.571721 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.571816 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.572041 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.572141 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.572401 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.572487 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.572725 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.572835 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.573033 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.573120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.573347 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.573433 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.573658 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.573744 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.574018 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.574112 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.574280 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.574364 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.574594 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.574681 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.574912 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.574996 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.575221 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.575307 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.575546 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.575635 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.575858 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.575943 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.576283 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.576389 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.576606 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.576694 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.576920 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.577007 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.577242 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.577335 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.577558 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.577644 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.577868 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.577959 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.578192 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.578292 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.578501 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.578594 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.578827 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.578913 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.579142 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.579229 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.579473 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.579560 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.579797 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.579883 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.580105 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.580209 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.580434 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.580522 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.580742 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.580828 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.581056 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.581143 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.581365 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.581449 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.581673 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.581758 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.581979 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.582067 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.582284 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.582370 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.582591 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.582698 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.582897 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.582995 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.583199 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.583285 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.583502 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.583596 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.583808 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.583901 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.584152 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.584252 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.584437 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.584530 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.584743 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.584865 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.585048 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.585133 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.585347 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.585441 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.585651 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.585735 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.585973 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.586066 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.586280 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.586405 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.586589 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.586671 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.586872 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.586958 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.587174 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.587262 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.587479 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.587565 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.587782 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.587866 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.588086 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.588191 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.588418 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.588504 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.588754 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.588850 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.589077 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.589176 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.589390 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.589476 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.589713 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.589809 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.590070 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.590163 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.590347 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.590440 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.590658 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.590751 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.590980 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.591060 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.591291 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.591375 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.591607 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.591700 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.591921 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.592014 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.592258 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.592347 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.592575 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.592682 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.592894 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.592985 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.593197 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.593289 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.593509 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.593596 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.593821 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.593905 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.594137 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.594231 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.594444 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.594538 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.594771 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.594857 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.595077 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.595162 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.595399 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.595486 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.595719 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.595812 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.596029 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.596136 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.596370 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.596457 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.596685 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.596770 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.596999 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.597094 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.597312 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.597398 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.597625 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.597718 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.597937 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.598035 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.598252 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.598336 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.598564 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.598649 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.598876 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.598970 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.599187 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.599272 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.599502 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.599589 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.599823 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.599911 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.600163 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.600253 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.600478 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.600565 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.600811 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.600898 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.601126 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.601220 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.601456 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.601550 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.602322 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.602489 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.602675 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.602762 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.603062 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.603156 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.603382 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.603468 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.603696 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.603783 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.604005 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.604100 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.604280 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:50:36.604383 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.604679 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:50:36.604928 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110000) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:50:36.667346 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO dbcounter [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Registered counter for database nova_api Jul 25 05:50:36.667540 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO dbcounter [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] Registered counter for database nova_api Jul 25 05:50:36.779987 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG oslo_db.sqlalchemy.engines [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:50:36.782547 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_db.sqlalchemy.engines [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:50:36.786526 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG dbcounter [-] [110000] Writer thread running {{(pid=110000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:50:36.788848 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writer thread running {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:50:36.843470 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.context [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd564ae1-4e01-4f80-b362-1614dcc559db(cell1) {{(pid=110000) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:50:36.845001 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.context [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd564ae1-4e01-4f80-b362-1614dcc559db(cell1) {{(pid=109999) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:50:36.847359 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG oslo_concurrency.lockutils [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:36.848982 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:36.849157 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG oslo_concurrency.lockutils [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:36.849768 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG oslo_concurrency.lockutils [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:36.850559 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:36.851347 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:50:36.852479 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG oslo_concurrency.lockutils [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110000) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:36.854087 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:50:36.854445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO dbcounter [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] Registered counter for database nova_cell0 Jul 25 05:50:36.856048 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO dbcounter [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Registered counter for database nova_cell0 Jul 25 05:50:36.858309 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO dbcounter [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] Registered counter for database nova_cell1 Jul 25 05:50:36.860040 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO dbcounter [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Registered counter for database nova_cell1 Jul 25 05:50:36.865892 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG oslo_db.sqlalchemy.engines [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:50:36.868781 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_db.sqlalchemy.engines [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:50:36.869885 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_db.sqlalchemy.engines [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:50:36.873248 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG oslo_db.sqlalchemy.engines [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:50:36.875811 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writer thread running {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:50:36.877564 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG dbcounter [-] [110000] Writer thread running {{(pid=110000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:50:36.878401 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writer thread running {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:50:37.015753 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG dbcounter [-] [110000] Writer thread running {{(pid=110000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:50:37.024581 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO dbcounter [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Registered counter for database nova_cell0 Jul 25 05:50:37.026527 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO dbcounter [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] Registered counter for database nova_cell0 Jul 25 05:50:37.033350 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_db.sqlalchemy.engines [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:50:37.036942 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG oslo_db.sqlalchemy.engines [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110000) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:50:37.037772 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writer thread running {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:50:37.042188 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG dbcounter [-] [110000] Writer thread running {{(pid=110000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:50:37.447577 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: WARNING keystonemiddleware.auth_token [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:50:37.454817 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: WARNING keystonemiddleware.auth_token [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:50:37.473118 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: WARNING keystonemiddleware.auth_token [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:50:37.481062 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: WARNING keystonemiddleware.auth_token [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:50:37.803617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: WARNING keystonemiddleware.auth_token [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:50:37.810582 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: WARNING keystonemiddleware.auth_token [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:50:37.815794 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fe91a859c0 pid: 109999 (default app) Jul 25 05:50:37.817878 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bfa190>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:50:37.819060 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Jul 25 05:50:37.819463 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Mon Jul 25 05:50:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:50:37.823582 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: WARNING keystonemiddleware.auth_token [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:50:37.829536 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: WARNING keystonemiddleware.auth_token [None req-c775e7ae-8757-42e6-90a1-1aba0437e615 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:50:37.834755 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fe91a859c0 pid: 110000 (default app) Jul 25 05:51:56.866580 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bfa190>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:56.867673 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 25 05:51:56.868099 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:51:56.881273 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG dbcounter [-] [110000] Writing DB stats nova_api:SELECT=3 {{(pid=110000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:56.883749 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG dbcounter [-] [110000] Writing DB stats nova_cell0:SELECT=3 {{(pid=110000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:56.883749 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG dbcounter [-] [110000] Writing DB stats nova_cell1:SELECT=3 {{(pid=110000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:56.884341 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG dbcounter [-] [110000] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:57.738407 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-f4f922ce-343a-4557-8eaa-145a3038831f admin admin] Calling method '<bound method FlavorsController.detail of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e11716eb0>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:51:57.773080 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-f4f922ce-343a-4557-8eaa-145a3038831f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.897942 Jul 25 05:51:57.773850 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Mon Jul 25 05:51:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:59.999375 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bfa190>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:00.000502 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-25598728-b1a8-4999-acba-36b19cfa9afe None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 25 05:52:00.000888 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:51:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:00.458128 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-9d152022-1ff9-4f18-91bf-853de1215a3e admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11716ee0>>, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "id": "c1"}} {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:00.485086 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:52:00.485086 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: warnings.warn(msg) Jul 25 05:52:00.601985 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-9d152022-1ff9-4f18-91bf-853de1215a3e admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.595168 Jul 25 05:52:00.602553 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Jul 25 05:52:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 05:52:00.616543 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writing DB stats nova_api:SELECT=3 {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:00.617761 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writing DB stats nova_cell0:SELECT=3 {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:00.618524 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writing DB stats nova_cell1:SELECT=3 {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:00.619280 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:00.827179 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-56865eb1-5419-4f28-8516-4235f8e9ff56 admin admin] Action: 'create', calling method: <bound method FlavorExtraSpecsController.create of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e1172c430>>, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:00.829633 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:52:00.829633 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: warnings.warn(msg) Jul 25 05:52:00.988648 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-56865eb1-5419-4f28-8516-4235f8e9ff56 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.377200 Jul 25 05:52:00.999522 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Mon Jul 25 05:52:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:52:03.238377 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-9d152022-1ff9-4f18-91bf-853de1215a3e admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:03.240715 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-9d152022-1ff9-4f18-91bf-853de1215a3e admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003515 Jul 25 05:52:03.241193 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:03.905448 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-4b9f11cc-342f-4dec-8b64-3dc5d6e5c37a admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11721040>>, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "swap": 0, "rxtx_factor": 1.0}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:03.923703 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:52:03.923703 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: warnings.warn(msg) Jul 25 05:52:04.005119 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-4b9f11cc-342f-4dec-8b64-3dc5d6e5c37a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.756326 Jul 25 05:52:04.005678 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Jul 25 05:52:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:04.017404 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-44d541ef-9499-410e-8eee-296aabefc07d admin admin] Action: 'create', calling method: <bound method FlavorExtraSpecsController.create of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e11726670>>, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:04.018968 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:52:04.018968 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: warnings.warn(msg) Jul 25 05:52:04.144966 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-44d541ef-9499-410e-8eee-296aabefc07d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131234 Jul 25 05:52:04.145734 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Mon Jul 25 05:52:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:52:06.364308 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-4b9f11cc-342f-4dec-8b64-3dc5d6e5c37a admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bfa190>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:06.365354 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-4b9f11cc-342f-4dec-8b64-3dc5d6e5c37a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 25 05:52:06.365755 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:06.764401 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-a52df9b1-5964-4f9f-ad43-60dc1cc09d53 admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11716ee0>>, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "ds1G"}} {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:06.830073 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-a52df9b1-5964-4f9f-ad43-60dc1cc09d53 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458449 Jul 25 05:52:06.830622 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Jul 25 05:52:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:06.843464 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-2cac66b2-f485-41e5-a725-54cecbeb45ad admin admin] Action: 'create', calling method: <bound method FlavorExtraSpecsController.create of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e1172c430>>, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:06.915657 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-2cac66b2-f485-41e5-a725-54cecbeb45ad admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076153 Jul 25 05:52:06.916263 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Mon Jul 25 05:52:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:52:09.163433 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-a52df9b1-5964-4f9f-ad43-60dc1cc09d53 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:09.164558 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-a52df9b1-5964-4f9f-ad43-60dc1cc09d53 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jul 25 05:52:09.164963 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:52:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:09.627272 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-a5223ef8-1906-4b04-9ff1-537285d42dde admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11721040>>, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "swap": 0}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:09.706935 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-a5223ef8-1906-4b04-9ff1-537285d42dde admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.536159 Jul 25 05:52:09.708046 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Jul 25 05:52:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:09.719960 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-61f6060a-62cd-47aa-846e-9bc5eb3e87d2 admin admin] Action: 'create', calling method: <bound method FlavorExtraSpecsController.create of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e11726670>>, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:09.807023 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-61f6060a-62cd-47aa-846e-9bc5eb3e87d2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090687 Jul 25 05:52:09.807715 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Mon Jul 25 05:52:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:52:12.057515 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-a5223ef8-1906-4b04-9ff1-537285d42dde admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bfa190>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:12.058541 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-a5223ef8-1906-4b04-9ff1-537285d42dde admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 25 05:52:12.058948 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:12.494767 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-692850f5-11ff-4977-9c73-e1d582f29318 admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11716ee0>>, body: {"flavor": {"ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:12.575671 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-692850f5-11ff-4977-9c73-e1d582f29318 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510437 Jul 25 05:52:12.576483 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Jul 25 05:52:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:12.588713 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-3af5e1ef-e4b9-43ed-beaf-3964c3c2af41 admin admin] Action: 'create', calling method: <bound method FlavorExtraSpecsController.create of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e1172c430>>, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:12.681530 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-3af5e1ef-e4b9-43ed-beaf-3964c3c2af41 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096339 Jul 25 05:52:12.682177 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Mon Jul 25 05:52:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:52:14.933082 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-692850f5-11ff-4977-9c73-e1d582f29318 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:14.934220 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-692850f5-11ff-4977-9c73-e1d582f29318 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jul 25 05:52:14.934695 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:52:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:15.359639 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-2523ec20-a871-4a96-848a-ac2e676c9977 admin admin] Calling method '<bound method FlavorsController.detail of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171bfd0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:15.383823 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-2523ec20-a871-4a96-848a-ac2e676c9977 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.441709 Jul 25 05:52:15.384462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Mon Jul 25 05:52:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:52:17.639866 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-692850f5-11ff-4977-9c73-e1d582f29318 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:17.640955 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-692850f5-11ff-4977-9c73-e1d582f29318 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 25 05:52:17.641357 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:52:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:18.101098 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-0da7f04b-2d72-4912-8551-8519b32b544a admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11721040>>, body: {"flavor": {"id": "1", "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:18.180666 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-0da7f04b-2d72-4912-8551-8519b32b544a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.533159 Jul 25 05:52:18.181222 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Jul 25 05:52:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:18.193123 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-b2ed8ca5-1ce2-4b5e-aeba-4bf36899e2d8 admin admin] Action: 'create', calling method: <bound method FlavorExtraSpecsController.create of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e11726670>>, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:18.281515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-b2ed8ca5-1ce2-4b5e-aeba-4bf36899e2d8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091901 Jul 25 05:52:18.281961 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Mon Jul 25 05:52:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:52:20.523563 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-0da7f04b-2d72-4912-8551-8519b32b544a admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bfa190>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:20.524755 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-0da7f04b-2d72-4912-8551-8519b32b544a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Jul 25 05:52:20.525243 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:20.930233 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-99ec6a45-e9e6-4e9e-8cf1-eba917583829 admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11716ee0>>, body: {"flavor": {"id": "2", "swap": 0, "disk": 20, "name": "m1.small", "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:21.005387 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-99ec6a45-e9e6-4e9e-8cf1-eba917583829 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473869 Jul 25 05:52:21.005860 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Jul 25 05:52:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:21.018585 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-cc44b3aa-afda-49c2-a1d3-c3d8c3cc76fa admin admin] Action: 'create', calling method: <bound method FlavorExtraSpecsController.create of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e1172c430>>, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:21.126900 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-cc44b3aa-afda-49c2-a1d3-c3d8c3cc76fa admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112494 Jul 25 05:52:21.128537 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Mon Jul 25 05:52:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:52:23.383291 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-99ec6a45-e9e6-4e9e-8cf1-eba917583829 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:23.384480 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-99ec6a45-e9e6-4e9e-8cf1-eba917583829 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 25 05:52:23.384890 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:23.850072 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-1cecd3cc-e672-4f1c-b690-c870c8dc840f admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11721040>>, body: {"flavor": {"disk": 40, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:24.974370 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-1cecd3cc-e672-4f1c-b690-c870c8dc840f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.583202 Jul 25 05:52:24.975003 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Jul 25 05:52:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 05:52:24.987407 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-4e6fbf3b-11f8-47e4-8f56-3bd489fe7749 admin admin] Action: 'create', calling method: <bound method FlavorExtraSpecsController.create of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e11726670>>, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:25.120287 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-4e6fbf3b-11f8-47e4-8f56-3bd489fe7749 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137047 Jul 25 05:52:25.121392 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Mon Jul 25 05:52:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:52:27.393573 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-1cecd3cc-e672-4f1c-b690-c870c8dc840f admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bfa190>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:27.395207 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-1cecd3cc-e672-4f1c-b690-c870c8dc840f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002626 Jul 25 05:52:27.395758 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:27.867176 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-c394f7b7-887b-4719-bb82-e5dde39181b5 admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11716ee0>>, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "swap": 0, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80}} {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:27.872803 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG dbcounter [-] [110000] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:28.121237 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-c394f7b7-887b-4719-bb82-e5dde39181b5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.719629 Jul 25 05:52:28.128802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Jul 25 05:52:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:28.133739 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-3230bdd7-cd39-4685-8622-ef1235fad4da admin admin] Action: 'create', calling method: <bound method FlavorExtraSpecsController.create of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e1172c430>>, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:28.215728 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-3230bdd7-cd39-4685-8622-ef1235fad4da admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085685 Jul 25 05:52:28.216350 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Mon Jul 25 05:52:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:52:30.482729 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-c394f7b7-887b-4719-bb82-e5dde39181b5 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:30.491233 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-c394f7b7-887b-4719-bb82-e5dde39181b5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 25 05:52:30.491233 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:30.942483 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-7dc1c285-a385-4372-a82a-69fa3d29d4a3 admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11721040>>, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "ram": 16384}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:30.946990 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:31.010881 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-7dc1c285-a385-4372-a82a-69fa3d29d4a3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.519977 Jul 25 05:52:31.011771 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Mon Jul 25 05:52:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:31.024309 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-dfa47deb-834d-4e78-8e94-354c8c4ae4d0 admin admin] Action: 'create', calling method: <bound method FlavorExtraSpecsController.create of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e11726670>>, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:31.092466 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-dfa47deb-834d-4e78-8e94-354c8c4ae4d0 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071540 Jul 25 05:52:31.093021 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Mon Jul 25 05:52:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:52:50.880082 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-7dc1c285-a385-4372-a82a-69fa3d29d4a3 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bfa190>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:50.881120 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-7dc1c285-a385-4372-a82a-69fa3d29d4a3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 25 05:52:50.881522 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:52:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:50.891819 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG dbcounter [-] [110000] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:51.274070 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-070b3fee-0cf0-4778-8af6-8d8be58be870 admin admin] Calling method '<bound method FlavorsController.detail of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e11716eb0>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:51.291468 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-070b3fee-0cf0-4778-8af6-8d8be58be870 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404146 Jul 25 05:52:51.292002 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Mon Jul 25 05:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:52:52.353266 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-7dc1c285-a385-4372-a82a-69fa3d29d4a3 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bfa190>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:52.354270 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-7dc1c285-a385-4372-a82a-69fa3d29d4a3 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 25 05:52:52.354663 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:52.872050 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-c0e2ff98-1853-4073-9627-9139ab207322 admin admin] Calling method '<bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e117169a0>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:52.877966 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.wsgi [None req-c0e2ff98-1853-4073-9627-9139ab207322 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-c0e2ff98-1853-4073-9627-9139ab207322 admin admin] Request method failure captured: Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Accept: application/json Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Accept-Encoding: gzip, deflate Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Connection: keep-alive Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Content-Length: 0 Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Host: 10.222.0.40 Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Openstack-Api-Version: compute 2.90 Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Openstack-System-Scope: None Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: User-Agent: python-novaclient Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Auth-Token: gAAAAABi3i-0gTMLGpfH9eaE8gnyltfwd8xwpKI_L_aAxk7kRopqdXQRVVpoN0zCsAIruxJdvpt2mZhWf1uhxMkMPbLWmSop78_sgWafNPxG2i_pOuD_zBtYQGoBYa6PCXSX9xlzkr6BZOjy84hu9yK4hHP0yQv9rOE5KHj-i1j5iCE1OBwSQxM Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Domain-Id: None Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Domain-Name: None Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Identity-Status: Confirmed Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Is-Admin-Project: True Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Domain-Id: default Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Domain-Name: Default Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Name: admin Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Role: member,reader,admin Jul 25 05:52:52.881240 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Roles: member,reader,admin Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1d6ac2b8c3194197aedc989787229928", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Tenant: admin Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Tenant-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Tenant-Name: admin Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User: admin Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Domain-Id: default Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Domain-Name: Default Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Id: 2df7d0fe893f4cada8ecf1e428b8814a Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Name: admin Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: method: <bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e117169a0>> Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: exception: Flavor 42 could not be found. Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: action_args: {'id': '42'} Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:52:52.882802 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:52.883697 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:52.894445 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-c0e2ff98-1853-4073-9627-9139ab207322 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:52:52.895603 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-c0e2ff98-1853-4073-9627-9139ab207322 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393121 Jul 25 05:52:52.895603 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Jul 25 05:52:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:52.895758 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-2da4dc25-524a-4d77-9203-4344bc2b02b4 admin admin] Calling method '<bound method FlavorsController.index of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171b2e0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:52.915279 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-2da4dc25-524a-4d77-9203-4344bc2b02b4 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026157 Jul 25 05:52:52.915835 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Jul 25 05:52:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:52:52.925757 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-7f2f0b52-a018-46fa-be43-743733c0f394 admin admin] Calling method '<bound method FlavorsController.index of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e117161c0>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:52.947344 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-7f2f0b52-a018-46fa-be43-743733c0f394 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025095 Jul 25 05:52:52.947872 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Jul 25 05:52:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:52:52.958307 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-f7bbdc73-868e-4f1e-813f-32da76c5a931 admin admin] Calling method '<bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171bfa0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:52.964225 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.wsgi [None req-f7bbdc73-868e-4f1e-813f-32da76c5a931 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-f7bbdc73-868e-4f1e-813f-32da76c5a931 admin admin] Request method failure captured: Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Accept: application/json Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Accept-Encoding: gzip, deflate Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Connection: keep-alive Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Content-Length: 0 Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Host: 10.222.0.40 Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Openstack-Api-Version: compute 2.90 Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Openstack-System-Scope: None Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: User-Agent: python-novaclient Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Auth-Token: gAAAAABi3i-0gTMLGpfH9eaE8gnyltfwd8xwpKI_L_aAxk7kRopqdXQRVVpoN0zCsAIruxJdvpt2mZhWf1uhxMkMPbLWmSop78_sgWafNPxG2i_pOuD_zBtYQGoBYa6PCXSX9xlzkr6BZOjy84hu9yK4hHP0yQv9rOE5KHj-i1j5iCE1OBwSQxM Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Domain-Id: None Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Domain-Name: None Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Identity-Status: Confirmed Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Is-Admin-Project: True Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Domain-Id: default Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Domain-Name: Default Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Name: admin Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Role: member,reader,admin Jul 25 05:52:52.967460 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Roles: member,reader,admin Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1d6ac2b8c3194197aedc989787229928", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Tenant: admin Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Tenant-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Tenant-Name: admin Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User: admin Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Domain-Id: default Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Domain-Name: Default Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Id: 2df7d0fe893f4cada8ecf1e428b8814a Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Name: admin Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: method: <bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171bfa0>> Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: exception: Flavor 42 could not be found. Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: action_args: {'id': '42'} Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:52:52.970101 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:52.971144 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:52.972462 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-f7bbdc73-868e-4f1e-813f-32da76c5a931 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:52:52.973687 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-f7bbdc73-868e-4f1e-813f-32da76c5a931 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015280 Jul 25 05:52:52.973928 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Jul 25 05:52:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:53.943644 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-7f2f0b52-a018-46fa-be43-743733c0f394 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:53.944788 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-7f2f0b52-a018-46fa-be43-743733c0f394 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Jul 25 05:52:53.945186 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:54.460843 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-c7d6923d-6bb1-45ca-9b61-90736f6615a3 admin admin] Calling method '<bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171bfa0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:54.466592 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.wsgi [None req-c7d6923d-6bb1-45ca-9b61-90736f6615a3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-c7d6923d-6bb1-45ca-9b61-90736f6615a3 admin admin] Request method failure captured: Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Accept: application/json Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Accept-Encoding: gzip, deflate Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Connection: keep-alive Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Content-Length: 0 Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Host: 10.222.0.40 Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Openstack-Api-Version: compute 2.90 Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Openstack-System-Scope: None Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: User-Agent: python-novaclient Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Auth-Token: gAAAAABi3i-1ESJsPFShWbAj3pVJ9XooQwraxxtAK33LIRxNeDJbHC3S8rGii2LXF4cRho9LGt1wP1malev4PEGzw7jo_gH1a5UT3LQl1adWlv2T_fQkdEUKrzZEPlhTIRa713t6ftdiyO45kzew9_M8K6E3p1D8FRkjfYEhasS9b3shIjuPIiI Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Domain-Id: None Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Domain-Name: None Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Identity-Status: Confirmed Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Is-Admin-Project: True Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Domain-Id: default Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Domain-Name: Default Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Name: admin Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Role: member,reader,admin Jul 25 05:52:54.468100 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Roles: member,reader,admin Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1d6ac2b8c3194197aedc989787229928", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Tenant: admin Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Tenant-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Tenant-Name: admin Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User: admin Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Domain-Id: default Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Domain-Name: Default Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Id: 2df7d0fe893f4cada8ecf1e428b8814a Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Name: admin Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: method: <bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171bfa0>> Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: exception: Flavor 84 could not be found. Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: action_args: {'id': '84'} Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:52:54.469414 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:54.471124 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:54.472208 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-c7d6923d-6bb1-45ca-9b61-90736f6615a3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:52:54.473337 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-c7d6923d-6bb1-45ca-9b61-90736f6615a3 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.390124 Jul 25 05:52:54.473486 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Jul 25 05:52:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:54.482710 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-7e98559f-7345-445c-87d8-10199c2a1045 admin admin] Calling method '<bound method FlavorsController.index of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e117161c0>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:54.497365 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-7e98559f-7345-445c-87d8-10199c2a1045 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018279 Jul 25 05:52:54.497889 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Jul 25 05:52:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:52:54.507246 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-19b7b7b5-5724-4da5-82a2-ea513ff9f118 admin admin] Calling method '<bound method FlavorsController.index of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171b2e0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:54.520955 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-19b7b7b5-5724-4da5-82a2-ea513ff9f118 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017167 Jul 25 05:52:54.521483 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Jul 25 05:52:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:52:54.530559 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-29973f38-be5f-47e2-b66f-abab6d3fb06d admin admin] Calling method '<bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e117169a0>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:54.536678 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.wsgi [None req-29973f38-be5f-47e2-b66f-abab6d3fb06d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-29973f38-be5f-47e2-b66f-abab6d3fb06d admin admin] Request method failure captured: Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Accept: application/json Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Accept-Encoding: gzip, deflate Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Connection: keep-alive Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Content-Length: 0 Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Host: 10.222.0.40 Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Openstack-Api-Version: compute 2.90 Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Openstack-System-Scope: None Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: User-Agent: python-novaclient Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Auth-Token: gAAAAABi3i-1ESJsPFShWbAj3pVJ9XooQwraxxtAK33LIRxNeDJbHC3S8rGii2LXF4cRho9LGt1wP1malev4PEGzw7jo_gH1a5UT3LQl1adWlv2T_fQkdEUKrzZEPlhTIRa713t6ftdiyO45kzew9_M8K6E3p1D8FRkjfYEhasS9b3shIjuPIiI Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Domain-Id: None Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Domain-Name: None Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Identity-Status: Confirmed Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Is-Admin-Project: True Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Domain-Id: default Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Domain-Name: Default Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Name: admin Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Role: member,reader,admin Jul 25 05:52:54.538158 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Roles: member,reader,admin Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1d6ac2b8c3194197aedc989787229928", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Tenant: admin Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Tenant-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Tenant-Name: admin Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User: admin Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Domain-Id: default Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Domain-Name: Default Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Id: 2df7d0fe893f4cada8ecf1e428b8814a Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Name: admin Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: method: <bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e117169a0>> Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: exception: Flavor 84 could not be found. Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: action_args: {'id': '84'} Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:52:54.539724 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:54.540598 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:54.541698 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-29973f38-be5f-47e2-b66f-abab6d3fb06d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:52:54.542707 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-29973f38-be5f-47e2-b66f-abab6d3fb06d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012469 Jul 25 05:52:54.542707 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Mon Jul 25 05:52:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:55.505938 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-19b7b7b5-5724-4da5-82a2-ea513ff9f118 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bfa190>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:55.506959 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-19b7b7b5-5724-4da5-82a2-ea513ff9f118 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 25 05:52:55.507354 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:56.032512 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-25c8623f-4a5a-4c16-97fd-295f9974bd63 admin admin] Calling method '<bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e117169a0>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:56.038241 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.wsgi [None req-25c8623f-4a5a-4c16-97fd-295f9974bd63 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-25c8623f-4a5a-4c16-97fd-295f9974bd63 admin admin] Request method failure captured: Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Accept: application/json Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Accept-Encoding: gzip, deflate Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Connection: keep-alive Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Content-Length: 0 Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Host: 10.222.0.40 Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Openstack-Api-Version: compute 2.90 Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Openstack-System-Scope: None Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: User-Agent: python-novaclient Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Auth-Token: gAAAAABi3i-3qVGmGyY31oPiJWYWH6cSKumlJWH4QYIG6285C4qobWvmkoUV9LfE6s299wlWMGDesfNvBA_5RmpgMsjbHQpAHmz9zsKS5eaoFjEEtkAa0oOQuyryocbugfX8kZRfXKajVByX9sZ3qfCwOI2W6gfQVZNylz_rfiJ1Spw3L0U2sFg Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Domain-Id: None Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Domain-Name: None Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Identity-Status: Confirmed Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Is-Admin-Project: True Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Domain-Id: default Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Domain-Name: Default Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Project-Name: admin Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Role: member,reader,admin Jul 25 05:52:56.039733 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Roles: member,reader,admin Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1d6ac2b8c3194197aedc989787229928", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Tenant: admin Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Tenant-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-Tenant-Name: admin Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User: admin Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Domain-Id: default Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Domain-Name: Default Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Id: 2df7d0fe893f4cada8ecf1e428b8814a Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: X-User-Name: admin Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: method: <bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e117169a0>> Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: exception: Flavor 451 could not be found. Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: action_args: {'id': '451'} Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:52:56.041120 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:56.042183 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: ERROR nova.api.openstack.wsgi Jul 25 05:52:56.043515 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-25c8623f-4a5a-4c16-97fd-295f9974bd63 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110000) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:52:56.044760 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-25c8623f-4a5a-4c16-97fd-295f9974bd63 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.397504 Jul 25 05:52:56.044760 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Jul 25 05:52:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:56.050961 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-59b11f96-7c1f-4674-beea-8f5d3b8f4d40 admin admin] Calling method '<bound method FlavorsController.index of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171b2e0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:56.064974 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-59b11f96-7c1f-4674-beea-8f5d3b8f4d40 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017572 Jul 25 05:52:56.065498 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Jul 25 05:52:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:52:56.074593 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] Calling method '<bound method FlavorsController.index of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e117161c0>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:56.090170 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019012 Jul 25 05:52:56.090707 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Mon Jul 25 05:52:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:52:56.100074 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-fe30ba86-b37b-466f-a172-c4e51a4fcac7 admin admin] Calling method '<bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171bfa0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:56.105433 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.wsgi [None req-fe30ba86-b37b-466f-a172-c4e51a4fcac7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-fe30ba86-b37b-466f-a172-c4e51a4fcac7 admin admin] Request method failure captured: Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Accept: application/json Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Accept-Encoding: gzip, deflate Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Connection: keep-alive Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Content-Length: 0 Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Host: 10.222.0.40 Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Openstack-Api-Version: compute 2.90 Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Openstack-System-Scope: None Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: User-Agent: python-novaclient Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Auth-Token: gAAAAABi3i-3qVGmGyY31oPiJWYWH6cSKumlJWH4QYIG6285C4qobWvmkoUV9LfE6s299wlWMGDesfNvBA_5RmpgMsjbHQpAHmz9zsKS5eaoFjEEtkAa0oOQuyryocbugfX8kZRfXKajVByX9sZ3qfCwOI2W6gfQVZNylz_rfiJ1Spw3L0U2sFg Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Domain-Id: None Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Domain-Name: None Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Identity-Status: Confirmed Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Is-Admin-Project: True Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Domain-Id: default Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Domain-Name: Default Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Project-Name: admin Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Role: member,reader,admin Jul 25 05:52:56.106923 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Roles: member,reader,admin Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1d6ac2b8c3194197aedc989787229928", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1d6ac2b8c3194197aedc989787229928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Tenant: admin Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Tenant-Id: 1d6ac2b8c3194197aedc989787229928 Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-Tenant-Name: admin Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User: admin Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Domain-Id: default Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Domain-Name: Default Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Id: 2df7d0fe893f4cada8ecf1e428b8814a Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: X-User-Name: admin Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: method: <bound method FlavorsController.show of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171bfa0>> Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: exception: Flavor 451 could not be found. Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: action_args: {'id': '451'} Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:52:56.108497 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:56.109617 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: ERROR nova.api.openstack.wsgi Jul 25 05:52:56.111170 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-fe30ba86-b37b-466f-a172-c4e51a4fcac7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109999) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:52:56.112440 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-fe30ba86-b37b-466f-a172-c4e51a4fcac7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011751 Jul 25 05:52:56.112440 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Jul 25 05:52:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 05:52:57.074500 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:57.075623 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jul 25 05:52:57.076019 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:57.593693 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-a99f0908-d674-43c3-af36-b75a054a8b66 admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11721040>>, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:57.681077 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-a99f0908-d674-43c3-af36-b75a054a8b66 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.468130 Jul 25 05:52:57.681629 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Jul 25 05:52:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:58.644304 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:52:58.645334 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 25 05:52:58.645755 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:52:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:52:59.165770 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-b6c39ab8-3e44-4f10-9661-a75ab07eb32f admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11721040>>, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:52:59.257925 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-b6c39ab8-3e44-4f10-9661-a75ab07eb32f admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.472729 Jul 25 05:52:59.258471 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Jul 25 05:52:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:53:00.234413 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:00.235418 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 25 05:53:00.235815 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:53:00.758484 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-338861d6-d34e-457b-84d0-c6126ff8f772 admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11721040>>, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:53:00.818622 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-338861d6-d34e-457b-84d0-c6126ff8f772 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.442961 Jul 25 05:53:00.819165 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Jul 25 05:53:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 05:53:01.784286 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:01.785316 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 25 05:53:01.785711 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:53:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:53:02.306486 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-c8559ab2-ed38-46e0-a5d3-4dffbb9d7649 admin admin] Action: 'create', calling method: <bound method FlavorManageController._create of <nova.api.openstack.compute.flavor_manage.FlavorManageController object at 0x7f3e11721040>>, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:53:02.395352 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-c8559ab2-ed38-46e0-a5d3-4dffbb9d7649 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.471796 Jul 25 05:53:02.395901 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Mon Jul 25 05:53:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:53:03.364636 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:03.365650 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 25 05:53:03.366053 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:53:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:53:03.889373 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-9bd99d9a-86a2-41c3-a5fa-00ca4d767a1a admin admin] Calling method '<bound method FlavorsController.detail of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171bfd0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:03.909225 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-9bd99d9a-86a2-41c3-a5fa-00ca4d767a1a admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405553 Jul 25 05:53:03.909750 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Mon Jul 25 05:53:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:53:55.762004 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:55.763040 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-ef1333f9-acfa-4cb3-b2e2-fd18c99e0096 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 25 05:53:55.763988 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Mon Jul 25 05:53:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:53:55.774723 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:53:56.158758 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-86b7e690-da17-4121-9107-6732979a2ce4 admin admin] Calling method '<bound method FlavorsController.detail of <nova.api.openstack.compute.flavors.FlavorsController object at 0x7f3e1171bfd0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:56.177720 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-86b7e690-da17-4121-9107-6732979a2ce4 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407560 Jul 25 05:53:56.178254 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Mon Jul 25 05:53:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:53:56.199483 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG dbcounter [-] [110000] Writing DB stats nova_api:SELECT=14 {{(pid=110000) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:53:56.203829 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-45a07f6b-5c8a-4445-933c-df942da1d70d admin admin] Calling method '<bound method FlavorExtraSpecsController.index of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e11720d90>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:56.211303 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-45a07f6b-5c8a-4445-933c-df942da1d70d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013242 Jul 25 05:53:56.216234 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Mon Jul 25 05:53:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:53:56.223347 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-6d283d6c-02d8-4c9f-a2ef-6110477fdefe admin admin] Calling method '<bound method FlavorExtraSpecsController.index of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e11728b50>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:56.230855 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-6d283d6c-02d8-4c9f-a2ef-6110477fdefe admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011023 Jul 25 05:53:56.231364 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Mon Jul 25 05:53:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:53:56.243081 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-0194b75f-dfe0-4900-8475-cf593ab1c0bf admin admin] Calling method '<bound method FlavorExtraSpecsController.index of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e11720d90>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:56.251029 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-0194b75f-dfe0-4900-8475-cf593ab1c0bf admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011737 Jul 25 05:53:56.251534 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Mon Jul 25 05:53:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:53:56.262626 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-b8019eaf-428c-4cbb-bff0-63c18b88d27e admin admin] Calling method '<bound method FlavorExtraSpecsController.index of <nova.api.openstack.compute.flavors_extraspecs.FlavorExtraSpecsController object at 0x7f3e11728b50>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:53:56.270757 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-b8019eaf-428c-4cbb-bff0-63c18b88d27e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011607 Jul 25 05:53:56.271268 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Mon Jul 25 05:53:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:57:23.549112 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-0194b75f-dfe0-4900-8475-cf593ab1c0bf admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:57:23.550126 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-0194b75f-dfe0-4900-8475-cf593ab1c0bf admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 25 05:57:23.550553 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:57:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:57:23.694043 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writing DB stats nova_api:SELECT=6 {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:23.853468 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-83514afd-f53b-45ba-a8a9-64735592059a admin admin] Calling method '<bound method ServiceController.index of <nova.api.openstack.compute.services.ServiceController object at 0x7f3e116128b0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:57:23.854632 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:57:23.854632 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: warnings.warn(msg) Jul 25 05:57:23.856395 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-83514afd-f53b-45ba-a8a9-64735592059a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:23.856838 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-83514afd-f53b-45ba-a8a9-64735592059a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:23.857614 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-83514afd-f53b-45ba-a8a9-64735592059a admin admin] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:23.858046 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-83514afd-f53b-45ba-a8a9-64735592059a admin admin] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:23.890982 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-83514afd-f53b-45ba-a8a9-64735592059a admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198417 Jul 25 05:57:23.891540 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Jul 25 05:57:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:57:24.732563 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-0194b75f-dfe0-4900-8475-cf593ab1c0bf admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:57:24.733586 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-0194b75f-dfe0-4900-8475-cf593ab1c0bf admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jul 25 05:57:24.734028 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:57:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:57:24.927539 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-8d738c41-3155-44e1-8f81-764ca1575a97 admin admin] Calling method '<bound method ServiceController.index of <nova.api.openstack.compute.services.ServiceController object at 0x7f3e116128b0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:57:24.928761 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:57:24.928761 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: warnings.warn(msg) Jul 25 05:57:24.930029 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-8d738c41-3155-44e1-8f81-764ca1575a97 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:24.930475 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-8d738c41-3155-44e1-8f81-764ca1575a97 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:24.931255 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-8d738c41-3155-44e1-8f81-764ca1575a97 admin admin] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:24.931690 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-8d738c41-3155-44e1-8f81-764ca1575a97 admin admin] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:24.951790 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-8d738c41-3155-44e1-8f81-764ca1575a97 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076560 Jul 25 05:57:24.952374 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Jul 25 05:57:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 05:57:36.210666 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-0194b75f-dfe0-4900-8475-cf593ab1c0bf admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:57:36.211673 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-0194b75f-dfe0-4900-8475-cf593ab1c0bf admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 25 05:57:36.212095 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:57:36.353364 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writing DB stats nova_cell0:SELECT=4 {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:36.354206 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writing DB stats nova_cell1:SELECT=4 {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:36.354842 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG dbcounter [-] [109999] Writing DB stats nova_api:SELECT=8 {{(pid=109999) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:57:36.403045 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-2563e337-22c2-4415-b737-f9ae27151303 admin admin] Calling method '<bound method ServiceController.index of <nova.api.openstack.compute.services.ServiceController object at 0x7f3e116128b0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:57:36.404288 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:57:36.404288 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: warnings.warn(msg) Jul 25 05:57:36.407973 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-2563e337-22c2-4415-b737-f9ae27151303 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:36.407973 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-2563e337-22c2-4415-b737-f9ae27151303 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:36.407973 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-2563e337-22c2-4415-b737-f9ae27151303 admin admin] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:36.407973 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-2563e337-22c2-4415-b737-f9ae27151303 admin admin] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:36.434474 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-2563e337-22c2-4415-b737-f9ae27151303 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084861 Jul 25 05:57:36.434955 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Jul 25 05:57:36 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:57:37.281374 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: DEBUG nova.api.openstack.wsgi [None req-0194b75f-dfe0-4900-8475-cf593ab1c0bf admin admin] Calling method '<bound method VersionsV2.index of <nova.api.openstack.compute.versions.VersionsV2 object at 0x7f3e11bf9400>>' {{(pid=110000) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:57:37.282626 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: INFO nova.api.openstack.requestlog [None req-0194b75f-dfe0-4900-8475-cf593ab1c0bf admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 25 05:57:37.283021 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: [pid: 110000|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Mon Jul 25 05:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:57:37.473526 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG nova.api.openstack.wsgi [None req-2dec7641-84d1-4945-934c-f239f1a652a8 admin admin] Calling method '<bound method ServiceController.index of <nova.api.openstack.compute.services.ServiceController object at 0x7f3e116128b0>>' {{(pid=109999) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:57:37.474690 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 05:57:37.474690 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: warnings.warn(msg) Jul 25 05:57:37.475927 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-2dec7641-84d1-4945-934c-f239f1a652a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:37.476457 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-2dec7641-84d1-4945-934c-f239f1a652a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:37.477252 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-2dec7641-84d1-4945-934c-f239f1a652a8 admin admin] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:57:37.477687 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: DEBUG oslo_concurrency.lockutils [None req-2dec7641-84d1-4945-934c-f239f1a652a8 admin admin] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109999) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:57:37.500037 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: INFO nova.api.openstack.requestlog [None req-2dec7641-84d1-4945-934c-f239f1a652a8 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077416 Jul 25 05:57:37.500554 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: [pid: 109999|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Mon Jul 25 05:57:37 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:58:33.255432 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: Mon Jul 25 05:58:33 2022 - graceful shutdown triggered... Jul 25 05:58:33.255984 dv-cinder-848418-2-iscsi devstack@n-api.service[110000]: Gracefully killing worker 2 (pid: 110000)... Jul 25 05:58:33.256396 dv-cinder-848418-2-iscsi devstack@n-api.service[109999]: Gracefully killing worker 1 (pid: 109999)... Jul 25 05:58:33.257794 dv-cinder-848418-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 05:58:34.256574 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: worker 1 buried after 1 seconds Jul 25 05:58:34.257081 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: worker 2 buried after 1 seconds Jul 25 05:58:34.257081 dv-cinder-848418-2-iscsi devstack@n-api.service[109998]: goodbye to uWSGI. Jul 25 05:58:34.258171 dv-cinder-848418-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 25 05:58:34.258716 dv-cinder-848418-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 05:58:34.261572 dv-cinder-848418-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 05:58:34.271465 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 05:58:34 2022] *** Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: nodename: dv-cinder-848418-2-iscsi Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: machine: x86_64 Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: clock source: unix Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: pcre jit disabled Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: detected number of CPU cores: 4 Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: current working directory: / Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: detected binary path: /usr/bin/uwsgi-core Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: your processes number limit is 47680 Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: your memory page size is 4096 bytes Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: detected max file descriptor number: 2048 Jul 25 05:58:34.274255 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: lock engine: pthread robust mutexes Jul 25 05:58:34.275268 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: thunder lock: enabled Jul 25 05:58:34.275268 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 05:58:34.275268 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 05:58:34.319715 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: Python main interpreter initialized at 0x5590671609c0 Jul 25 05:58:34.319715 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: python threads support enabled Jul 25 05:58:34.319715 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: your server socket listen backlog is limited to 100 connections Jul 25 05:58:34.319715 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: your mercy for graceful operations on workers is 90 seconds Jul 25 05:58:34.320131 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 05:58:34.320131 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: *** Operational MODE: preforking *** Jul 25 05:58:34.320284 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: *** uWSGI is running in multiple interpreter mode *** Jul 25 05:58:34.320284 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: spawned uWSGI master process (pid: 124905) Jul 25 05:58:34.320479 dv-cinder-848418-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 05:58:34.323122 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: spawned uWSGI worker 1 (pid: 124917, cores: 1) Jul 25 05:58:34.323122 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: spawned uWSGI worker 2 (pid: 124918, cores: 1) Jul 25 05:58:34.323122 dv-cinder-848418-2-iscsi devstack@n-api.service[124905]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 05:58:34.996671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:58:35.006911 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 05:58:36.195827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:58:36.195827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: from cryptography.utils import int_from_bytes Jul 25 05:58:36.196486 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:58:36.196486 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: from cryptography.utils import int_from_bytes Jul 25 05:58:36.209878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:58:36.209878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: from cryptography.utils import int_from_bytes Jul 25 05:58:36.210483 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:58:36.210483 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: from cryptography.utils import int_from_bytes Jul 25 05:58:38.512049 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:58:38.512769 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:58:38.512866 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:58:38.513207 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:58:38.513464 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:58:38.513992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.514800 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.515201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.515522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.515901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.516287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.516562 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.516884 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.517213 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.517474 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.517790 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.518115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848418-2-iscsi {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.518437 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.518745 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.519054 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.519370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.519673 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.519996 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.520326 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.520890 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.521726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.521726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.521912 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.522184 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.522655 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.522866 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.523125 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.523443 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.523758 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.524067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.524510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848418-2-iscsi {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.524842 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.525146 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.525459 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.525877 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.526190 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.526501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.526822 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.527157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.527465 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.527791 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.528131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.528450 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.528770 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.529074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.530194 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.530505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.530832 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.531138 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.531445 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.531694 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.532000 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.532348 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.541886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.541886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.541886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.541886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.541886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.541886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.542908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.543423 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.543423 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.543423 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.543423 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.543920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:58:38.544623 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.544700 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:58:38.544858 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.544858 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.545021 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:58:38.545222 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.545911 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:58:38.546042 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.546168 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:58:38.546291 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.546403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.552335 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.552529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.552708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.552858 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.553002 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.553286 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.553427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.553573 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.553711 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.553856 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.553993 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.554153 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.554292 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.555049 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.555157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.555157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.555340 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.555340 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.555512 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.555604 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.555697 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.555697 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.555697 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.555942 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848418-2-iscsi {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.556028 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.556180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.556328 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.556462 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.556577 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.556694 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.556815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.556815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.557029 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.557154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.557273 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.557390 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.557611 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.557740 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.557852 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.557972 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.558101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.558238 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.558350 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.558474 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.558595 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.558707 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.558828 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.558948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.558948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.559501 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.559638 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.559760 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.559878 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.560000 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.560154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.560332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.560465 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.560632 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.560802 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.560938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.561060 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.561172 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.561291 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.562203 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848418-2-iscsi {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.562329 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.562442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.562553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.562735 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.562852 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.562973 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.563086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.563086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.563300 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.563420 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.563542 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.563667 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.563779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.563894 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.564015 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.564190 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.564310 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.564513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.564679 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.564836 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.564968 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.565089 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.565216 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.565336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.565458 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.565576 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.565688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.565805 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.565925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.566044 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.566163 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.566274 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.566391 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.566503 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.566627 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.566781 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.566937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.567051 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.567168 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.567281 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.567401 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.567726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.567857 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.567970 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.568082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.570022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.570191 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.570355 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.570511 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.570511 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.570800 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.571042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.571203 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.571351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.571496 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.571496 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.571784 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.571931 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.572075 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.572289 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.572446 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.572599 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.572753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.572915 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.573060 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.573211 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.573365 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.573509 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.573663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.573807 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.573950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.574110 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.574256 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.574417 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.574570 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.574722 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.574888 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.575084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.575242 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.575398 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.575552 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.575697 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.575852 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.575996 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.576238 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.576670 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.576859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.577059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.577217 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.577381 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.577526 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.577681 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.577937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.578092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.578244 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.578389 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.578543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.579160 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.579319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.579466 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.579618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.579978 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.580166 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.580321 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.580465 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.580609 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.580764 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.580909 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.581073 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.581220 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.581410 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.581556 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.581708 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.581853 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.582118 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.582278 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.582435 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.582590 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.583045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.583266 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.583426 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.583578 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.583722 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.583876 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.584028 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.584240 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.584410 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.584567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.584833 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.584988 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.585132 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.585289 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.585441 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.585593 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.585756 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.585948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.586095 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.586252 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.586403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.586555 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.586718 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.586899 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.587058 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.587213 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.587391 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.587539 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.587689 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.590154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.590396 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.590558 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.590707 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.590853 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.591033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.591208 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.591368 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.591523 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.591678 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.591824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.592733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.598605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.598771 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.601234 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.601415 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.601607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.601778 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.601936 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.602099 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.602253 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.602405 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.602550 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.602739 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.602891 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.603045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.603198 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.603377 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.603555 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.603719 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.603866 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.604029 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.604242 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.604396 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.604551 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.604820 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.605085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.605237 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.605381 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.605534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.605692 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.605838 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.605985 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.606137 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.606345 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.606496 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.606673 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.607403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.607562 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.608359 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.608588 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.608750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.608911 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.609184 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.609338 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.609549 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.610092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.610259 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.610421 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.610583 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.610730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.610983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.612024 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.612237 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.612407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.612555 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:58:38.612701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.612853 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.612998 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.613204 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.613364 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.613364 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.613717 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.613872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.614025 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.614180 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.614335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.614488 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.614642 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.614794 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.614947 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.615105 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.615263 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.615409 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.615560 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.615705 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.615864 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.616056 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.616249 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.616407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.616746 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.616919 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.617078 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.617224 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.617412 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.617578 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.617740 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.617894 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.618052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.618244 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.618397 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.618543 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.618788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.618941 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.619099 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.619341 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.619489 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.619653 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.620222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.620399 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.620556 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.620701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.620853 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.621005 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.621151 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.621337 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.621487 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.621633 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.621784 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.622126 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.622299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.622552 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.622716 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.622862 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.623017 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.623163 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.623372 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.623571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.623725 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.623870 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.624021 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.624255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.624428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.624586 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.624732 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.624882 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.625034 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.625177 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.625379 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.625567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.625718 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.625864 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.626008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.626151 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.626304 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.626456 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.626664 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.626817 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.626963 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.627107 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.627269 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.627414 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.627602 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.627602 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.628066 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.628246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.628404 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.628561 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.628723 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.628998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.629165 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.629413 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.629567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.629567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.629918 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.630429 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.630591 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.630785 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.630943 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.631098 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.631252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.631449 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.631600 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.631755 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.631941 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.632365 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.632529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.632676 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.632828 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.633016 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.633169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.633323 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.633542 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.633693 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.633866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.634020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.634167 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.634319 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.634472 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.634625 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.634786 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.634939 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.635124 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.635283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.636187 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.639772 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.639959 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.640185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.640767 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.640917 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.641070 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.641223 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.641380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.641564 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.641743 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.641901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.642047 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.642206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.642582 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.642582 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.642891 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.643037 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.643181 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.643340 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.643487 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.643633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.643776 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.643931 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.644077 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.644331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.644484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.644671 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.644835 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.644981 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.645133 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.645408 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.645558 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.645704 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.645889 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.646042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.646202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.646355 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.646549 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.646702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.646849 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.647012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.647166 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.647319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.647471 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.647615 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.647767 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.647920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.648075 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.648303 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.648450 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.648605 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.648792 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.648955 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.649124 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.649279 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.649424 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.649612 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.649944 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.650107 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.650295 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.650857 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.651013 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.651159 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.651304 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.651463 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.651618 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.651782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.651928 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.652080 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.652263 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.652420 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.652811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.652976 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.653131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.653285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.653438 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.653593 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.653746 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.653909 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.654095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.654639 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.655402 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.655607 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.655782 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.655983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.655983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.656317 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.658442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.658614 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.658780 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.658935 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.659092 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.659237 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.659399 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.659545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.659699 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.659874 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.660207 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.660372 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.660548 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.661068 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.661230 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.661384 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.661533 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.661698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.661844 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.661987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.662731 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.663091 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.663091 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.663441 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.663441 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.663729 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.663883 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.664043 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.664228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.664376 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.664544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.664789 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.664789 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.665013 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.665134 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.665262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.665412 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.665537 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.665699 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.665826 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.665946 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.666065 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.666185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.666297 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.666460 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.666581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.666701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.666821 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.666941 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.667061 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.667188 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.667309 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.667420 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.667541 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.667654 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.667775 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.667895 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.668008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.668145 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.675295 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.675477 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.675656 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.675806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.675951 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.676103 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.676287 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.676443 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.676605 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.676772 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.676919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.677062 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.677207 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.677350 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.677504 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.677677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.677835 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.677979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.678142 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.678298 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.678452 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.678598 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.678753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.678898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.679043 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.679232 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.679389 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.679762 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.679912 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.680066 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.680298 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.680636 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.681824 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.682001 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.682178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.682331 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.682490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.682690 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.683097 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.683457 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.683632 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.683794 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.683961 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.684141 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.684313 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.684473 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.684626 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.684796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.685036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.685312 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.685312 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.685626 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.685837 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.686008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.686269 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.686512 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.686772 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.686989 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.687158 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.687311 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.687523 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.687683 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.687843 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.687995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.688185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.688357 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.688509 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.688667 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.688827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.688980 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.689130 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.689353 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.689509 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.689678 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.689872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.690040 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.690201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.690362 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.690710 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.690881 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.691055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.691055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.691698 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.691862 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.692014 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.692185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.692365 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.692527 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.692689 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.692841 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.693766 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.693934 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.694096 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.694256 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.694418 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.694578 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.694732 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.694892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.695064 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.695201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.695303 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.695509 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.695615 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.695705 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.695800 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.695888 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.695985 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.696178 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.696353 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.696505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.696665 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.696836 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.696989 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.697142 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.697305 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.697465 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.697624 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.697975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.698150 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.698304 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.698304 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.698600 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.698751 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.698949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.699117 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.699270 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.699419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.699568 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.699719 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.699878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.700075 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.700321 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.700476 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.700789 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.700967 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.701155 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.702301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.702480 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.702640 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.702801 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.702954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.703116 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.703319 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.703482 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.703868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.704037 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.704214 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.704381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.704535 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.704723 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.704906 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.705068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.705256 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.705412 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.705564 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.705767 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.705936 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.706097 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.706260 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.706501 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.706670 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.706864 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.706998 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.707121 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.707234 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.707383 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.707502 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.707630 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.707752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.707865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.707982 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.707982 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.712636 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.712795 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.712906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713008 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713096 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713171 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713261 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713344 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713418 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713641 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713725 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713807 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713879 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.713948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714107 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714107 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714254 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714402 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714474 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714557 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714629 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714700 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714769 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714846 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.714925 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715091 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715171 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715252 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715323 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715393 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715477 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715477 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715628 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715701 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715770 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715839 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.715995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716072 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716214 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716294 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716365 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716450 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716601 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716671 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716740 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716740 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716996 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.716996 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.717737 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.717826 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.717910 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.718012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.718107 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.718193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.718276 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.718421 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.718512 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.718606 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.718692 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.718783 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.718876 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.718970 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.719054 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.719136 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.719228 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.719312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.719402 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.719488 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.719580 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.719673 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.719758 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.719842 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.719933 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720018 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720130 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720231 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720317 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720401 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720492 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720757 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720757 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720918 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.720918 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.721067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.721161 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.721247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.721344 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.721430 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.721513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.721614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.721700 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.721792 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.721876 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.721966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.722058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.722151 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.722257 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.722344 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.722437 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.722522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.722604 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.722702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.722796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.722890 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.722975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.723058 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.723142 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.723239 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.723325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.723416 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.723508 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.723600 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.723772 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.723860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.723953 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.724039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.724039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.724253 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.724359 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.724446 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.724538 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.724629 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.724721 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.724806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.724903 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.724988 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.725072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.725154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.725238 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.725329 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.725415 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.725498 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.725581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.725663 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.725753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.725851 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.725936 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.726026 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.726119 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.726210 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.726302 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.726396 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.726396 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.726564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.726648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.726739 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.726823 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.726919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727010 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727095 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727186 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727271 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727353 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727446 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727531 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727622 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727706 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727894 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.727979 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.728069 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.728189 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.728276 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.728360 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.728456 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.728543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.728627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.728711 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.728801 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.728894 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.728988 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729081 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729166 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729257 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729342 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729426 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729609 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729700 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729785 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729876 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729974 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.729974 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.730136 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.730222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.730305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.730398 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.730491 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.730584 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.730670 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.730805 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.730909 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.730992 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.731077 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.731170 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.731255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.731338 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.731430 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.731519 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.731602 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.731696 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.731781 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.731865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.731960 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.732054 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.732157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.732243 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.732328 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.732411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.732512 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.732620 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.733195 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.733195 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.733363 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.733465 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.733552 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.733644 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.733730 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.733814 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.733906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734004 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734004 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734168 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734260 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734260 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734417 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734668 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.734905 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.735001 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.735001 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.735001 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.735001 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.735001 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.735389 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.735475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.735559 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.735642 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.735785 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.735904 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.736029 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.736211 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.736211 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.736425 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.736542 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.736652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.736840 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.736954 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.737063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.737172 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.737281 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.737388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.737507 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.737618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.737734 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.737846 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.737846 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738061 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738185 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738303 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738414 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738630 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738748 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.738975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.739590 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.739701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.739811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.739926 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.740045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.743933 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.743933 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.744257 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.744386 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.744531 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.744671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.744801 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.744932 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.745068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.745196 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.745342 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.745479 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.745607 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.745734 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.745863 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.746004 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.746141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.746277 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.746415 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.746543 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.746704 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.746843 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.746980 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.747663 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.747663 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.747924 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.748059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.748252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.749033 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.749186 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.749317 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.749594 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.749728 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.749865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.749995 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.750164 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.750294 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.750423 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.750558 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.750729 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.750860 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.751001 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.751139 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.751268 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.751396 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.751396 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.751656 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.751656 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.752010 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.752010 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.752299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.752299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.752299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.752785 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.752996 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.753135 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.753272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.753409 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.753549 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.753679 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.753818 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.753947 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.754082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.754218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.754356 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.754356 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.754615 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.754786 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.754786 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.755049 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.755049 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.755302 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.755430 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.755556 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.755556 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.755808 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.755937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.756064 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.756231 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.756358 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.756485 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.756625 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.756754 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.756883 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.757009 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.757136 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.757271 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.757414 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.757543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.757670 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.757796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.757796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.757796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.757796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.757796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.758435 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.758570 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.758570 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.758854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.758989 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.758989 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.759236 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.759362 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.759362 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.759620 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.759756 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.759884 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.760012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.760012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.760270 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.760416 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.760416 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.760652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.760779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.760913 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.761058 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.761058 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.761058 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.761438 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.761574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.761574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.761829 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.761959 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.761959 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.762303 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.762417 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.762417 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.762648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.762779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.762779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.763174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.763291 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.763291 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.763505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.763618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.763737 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.763945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.763945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.763945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.764358 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.764481 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.764481 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.764653 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.764737 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.764737 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.764941 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.765042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.765042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.765212 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.765304 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.765304 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.765554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.765648 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.765648 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.765857 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.765969 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.766113 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.766241 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.766241 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.766505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.766634 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.766634 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.766894 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.767052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.767052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.767267 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.767385 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.767385 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.767600 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.767718 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.767718 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.767931 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.768895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.769590 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.769590 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.769590 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.769895 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.770004 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.770123 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.770242 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.770242 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.770498 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.770635 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.770771 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.770900 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.771033 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.771168 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.771302 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.771430 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.771558 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.771558 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.771807 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.771807 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.772049 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.772218 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.772437 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.772581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.772714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.772856 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.773008 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.773299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.773432 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.773551 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.773680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.773819 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.773948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.773948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.774189 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.774364 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.774495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.774495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.774752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.774879 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.775038 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.775179 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.775316 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.775459 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.775459 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.775718 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.776440 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.776595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.776735 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.776735 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.776894 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.776987 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.777082 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.777177 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.777263 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.777348 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.777431 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.777542 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.777635 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.777858 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.777962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.778168 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.778268 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.778493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.778585 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.778809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.778911 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.779206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.779745 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.779841 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.780103 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.780261 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.780451 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.784272 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.784419 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.784518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.784619 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.784707 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.784800 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.784886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.784970 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.785062 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.785161 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.785256 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.785348 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.785435 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.785528 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.785623 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.785710 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.785803 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.785896 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.785983 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.786067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.786169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.786252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.786337 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.786428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.786514 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.786598 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.786749 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.786882 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.786979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787066 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787244 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787244 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787412 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787497 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787580 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787664 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787664 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787852 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787928 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.787928 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.788063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.788063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.788315 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.788390 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.788547 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.788703 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.788868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.789037 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.789195 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.789373 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.789510 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.789695 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.789830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.790029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.790152 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.790365 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.790474 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.790688 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.790919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.791242 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.791597 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.791932 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.792271 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.792387 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.792612 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.792734 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.792937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.793031 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.793257 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.793423 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.793592 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.793781 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.793964 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.794077 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.794247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.794371 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.794571 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.794682 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.794894 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.795002 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.795884 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.795984 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.796260 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.796362 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.796589 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.796726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.796911 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.797019 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.797360 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.797464 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.797540 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.797613 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.797855 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.797968 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.798181 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.798282 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.798516 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.798628 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.798835 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.799196 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.799301 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.799378 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.799585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.799660 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.799812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.799923 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.800076 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.800212 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.800403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.800504 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.800726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.800837 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.801253 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.801382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.801382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.801551 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.801635 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.801717 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.801944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.802061 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.802334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.802446 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.802651 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.802743 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.802896 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.802992 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.803197 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.803305 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.803514 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.803621 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.803839 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.803945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.804181 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.804283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.804500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.804609 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.804814 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.804920 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.805132 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.805243 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.805442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.805541 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.805758 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.805857 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.806082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.806196 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.806395 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.806503 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.806726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.806824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.807036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.807145 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.807375 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.807485 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.807663 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.807829 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.807986 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.808238 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.808394 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.808560 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.808715 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.808880 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.809204 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.809388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.809544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.809691 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.809838 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.809991 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.810147 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.810302 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.810449 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.810605 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.810857 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.811521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.811669 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.811814 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.811959 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.812104 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.812344 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.812632 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.812796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.812944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.813098 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.813253 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.813414 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.813572 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.813718 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.813871 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.814042 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.814226 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.814387 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.814549 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.814549 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.814826 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.814981 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.815135 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.815300 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.815454 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.815610 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.815777 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.816007 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.816215 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.816381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.816528 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.816674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.816818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.816972 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.817131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.817296 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.817471 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.817695 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.817847 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.818006 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.818170 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.818318 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.818474 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.818666 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.818666 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.818956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.819362 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.819517 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.819676 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.819847 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.819995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.820200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.820369 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.820526 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:58:38.820674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.820674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.820674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.820674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.821252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.821252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.821614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.821840 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.822153 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.822481 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.822809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.823133 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.823445 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.823783 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.824099 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.824438 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.824755 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.825073 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.825388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.825703 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.826020 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.826911 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.827188 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.827521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.828034 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.828392 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.828715 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.829032 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.829467 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.829682 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.829999 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.830316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.830638 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.830954 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.831277 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.831594 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.831910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.832973 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.832973 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.832973 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.833450 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.833596 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.833835 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.834168 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.834527 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.834843 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.835196 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.835533 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.835856 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.836195 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.836627 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:58:38.836783 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:58:38.974337 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO dbcounter [None req-38281703-8624-4776-938f-38996ae6271f None None] Registered counter for database nova_api Jul 25 05:58:38.989759 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO dbcounter [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] Registered counter for database nova_api Jul 25 05:58:38.995163 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_db.sqlalchemy.engines [None req-38281703-8624-4776-938f-38996ae6271f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:58:39.002437 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writer thread running {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:58:39.010057 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_db.sqlalchemy.engines [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:58:39.017330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writer thread running {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:58:39.059871 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.context [None req-38281703-8624-4776-938f-38996ae6271f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd564ae1-4e01-4f80-b362-1614dcc559db(cell1) {{(pid=124918) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:58:39.064660 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-38281703-8624-4776-938f-38996ae6271f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:39.066260 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-38281703-8624-4776-938f-38996ae6271f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:58:39.067095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-38281703-8624-4776-938f-38996ae6271f None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:39.069127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-38281703-8624-4776-938f-38996ae6271f None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:58:39.071105 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO dbcounter [None req-38281703-8624-4776-938f-38996ae6271f None None] Registered counter for database nova_cell0 Jul 25 05:58:39.073335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.context [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cd564ae1-4e01-4f80-b362-1614dcc559db(cell1) {{(pid=124917) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 05:58:39.075198 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO dbcounter [None req-38281703-8624-4776-938f-38996ae6271f None None] Registered counter for database nova_cell1 Jul 25 05:58:39.078109 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:39.079702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:58:39.080553 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:58:39.082567 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:58:39.083572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_db.sqlalchemy.engines [None req-38281703-8624-4776-938f-38996ae6271f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:58:39.084663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO dbcounter [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] Registered counter for database nova_cell0 Jul 25 05:58:39.084974 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_db.sqlalchemy.engines [None req-38281703-8624-4776-938f-38996ae6271f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:58:39.088751 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO dbcounter [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] Registered counter for database nova_cell1 Jul 25 05:58:39.092013 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writer thread running {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:58:39.093531 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writer thread running {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:58:39.095725 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_db.sqlalchemy.engines [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:58:39.097984 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_db.sqlalchemy.engines [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:58:39.103592 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writer thread running {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:58:39.105203 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writer thread running {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:58:39.242824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO dbcounter [None req-38281703-8624-4776-938f-38996ae6271f None None] Registered counter for database nova_cell0 Jul 25 05:58:39.250441 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_db.sqlalchemy.engines [None req-38281703-8624-4776-938f-38996ae6271f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:58:39.253676 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO dbcounter [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] Registered counter for database nova_cell0 Jul 25 05:58:39.255586 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writer thread running {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:58:39.260642 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_db.sqlalchemy.engines [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:58:39.265314 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writer thread running {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:58:39.575401 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: WARNING keystonemiddleware.auth_token [None req-38281703-8624-4776-938f-38996ae6271f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:58:39.581705 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: WARNING keystonemiddleware.auth_token [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:58:39.583401 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: WARNING keystonemiddleware.auth_token [None req-38281703-8624-4776-938f-38996ae6271f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:58:39.589256 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: WARNING keystonemiddleware.auth_token [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:58:39.930336 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: WARNING keystonemiddleware.auth_token [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:58:39.936492 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: WARNING keystonemiddleware.auth_token [None req-38281703-8624-4776-938f-38996ae6271f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 05:58:39.937149 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: WARNING keystonemiddleware.auth_token [None req-18604c1e-48fa-42ba-86f8-c713ad781b98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:58:39.942654 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: WARNING keystonemiddleware.auth_token [None req-38281703-8624-4776-938f-38996ae6271f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 05:58:39.943446 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5590671609c0 pid: 124917 (default app) Jul 25 05:58:39.948974 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5590671609c0 pid: 124918 (default app) Jul 25 05:59:21.169368 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=3 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:21.171297 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=3 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:21.172789 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=3 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:21.174140 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=3 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:21.973336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=3 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:21.974059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=3 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:21.974547 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=3 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:21.975590 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=3 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:22.818221 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-029649aa-12d6-455d-8276-afde90aa23d3 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6533dc8d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1373130129", "metadata": {"Type": "work"}}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-029649aa-12d6-455d-8276-afde90aa23d3 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Request method failure captured: Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 122 Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jE5n4iTrYDdMLThpSwXLBp4_FaQN09vz0dbLrGbGa8zLIJ9eTNmhmIfLLUXsdCUu9PKhsaj99KJ6q_C3xUseB2ml5Rxk25p7E_NonBB3hBvPOJq_V0kWD0pwqZDYTRxisNKv_TlF-NAEIQEUr-SVX2eZ8EFJ46nwsjmL0LEQO21wtE Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 05:59:22.836574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e5643d28676f47869722468e73718165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e5643d28676f47869722468e73718165", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: c65f4282dd1e4f028d535b49febe12ee Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1373130129", "metadata": {"Type": "work"}}} Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <function VolumeController.create at 0x7f6533dc8d30> Jul 25 05:59:22.837910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1373130129', 'metadata': {'Type': 'work'}}}} Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise error Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:22.838738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 05:59:22.840180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 05:59:22.841422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 05:59:22.841422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.841422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-029649aa-12d6-455d-8276-afde90aa23d3 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:22.841422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-029649aa-12d6-455d-8276-afde90aa23d3 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.688280 Jul 25 05:59:22.841422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1155 bytes} [Mon Jul 25 05:59:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1692 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 05:59:22.855925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0484d2f0-9655-4d7c-b16e-900949e64b69 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6533c8a040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-609337285", "metadata": {"Type": "work"}}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0484d2f0-9655-4d7c-b16e-900949e64b69 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Request method failure captured: Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 119 Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jE5n4iTrYDdMLThpSwXLBp4_FaQN09vz0dbLrGbGa8zLIJ9eTNmhmIfLLUXsdCUu9PKhsaj99KJ6q_C3xUseB2ml5Rxk25p7E_NonBB3hBvPOJq_V0kWD0pwqZDYTRxisNKv_TlF-NAEIQEUr-SVX2eZ8EFJ46nwsjmL0LEQO21wtE Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 05:59:22.861035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e5643d28676f47869722468e73718165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e5643d28676f47869722468e73718165", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: c65f4282dd1e4f028d535b49febe12ee Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-609337285", "metadata": {"Type": "work"}}} Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <function VolumeController.create at 0x7f6533c8a040> Jul 25 05:59:22.862670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-609337285', 'metadata': {'Type': 'work'}}}} Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise error Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi '0' Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:22.863681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 05:59:22.865411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 05:59:22.868384 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 05:59:22.868384 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.868384 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0484d2f0-9655-4d7c-b16e-900949e64b69 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:22.868384 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0484d2f0-9655-4d7c-b16e-900949e64b69 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011523 Jul 25 05:59:22.869528 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 2/2] 10.222.0.40 () {60 vars in 1155 bytes} [Mon Jul 25 05:59:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 05:59:22.877337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0abbc877-aa6d-4b8b-ae91-ac52742eead6 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6533ce6160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-3580639", "metadata": {"Type": "work"}}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0abbc877-aa6d-4b8b-ae91-ac52742eead6 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Request method failure captured: Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 116 Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jE5n4iTrYDdMLThpSwXLBp4_FaQN09vz0dbLrGbGa8zLIJ9eTNmhmIfLLUXsdCUu9PKhsaj99KJ6q_C3xUseB2ml5Rxk25p7E_NonBB3hBvPOJq_V0kWD0pwqZDYTRxisNKv_TlF-NAEIQEUr-SVX2eZ8EFJ46nwsjmL0LEQO21wtE Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 05:59:22.881983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e5643d28676f47869722468e73718165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e5643d28676f47869722468e73718165", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: c65f4282dd1e4f028d535b49febe12ee Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-3580639", "metadata": {"Type": "work"}}} Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <function VolumeController.create at 0x7f6533ce6160> Jul 25 05:59:22.883247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-3580639', 'metadata': {'Type': 'work'}}}} Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise error Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi '' Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:22.884072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 05:59:22.893669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 05:59:22.894845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 05:59:22.894845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:22.894845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0abbc877-aa6d-4b8b-ae91-ac52742eead6 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:22.894845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0abbc877-aa6d-4b8b-ae91-ac52742eead6 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012640 Jul 25 05:59:22.894845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 3/3] 10.222.0.40 () {60 vars in 1155 bytes} [Mon Jul 25 05:59:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 05:59:22.898041 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ed328b26-e1e2-40a9-8944-61b1c631d976 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533c8ad30>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:23.012088 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-41962fce-1b68-494b-9b66-78f415d918c7 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6533dc8ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-865501849"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:23.505473 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-ed328b26-e1e2-40a9-8944-61b1c631d976 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] HTTP exception thrown: Volume tempest-invalid-1703287972 could not be found. Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ed328b26-e1e2-40a9-8944-61b1c631d976 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Request method failure captured: Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1703287972 HTTP/1.1 Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jE5n4iTrYDdMLThpSwXLBp4_FaQN09vz0dbLrGbGa8zLIJ9eTNmhmIfLLUXsdCUu9PKhsaj99KJ6q_C3xUseB2ml5Rxk25p7E_NonBB3hBvPOJq_V0kWD0pwqZDYTRxisNKv_TlF-NAEIQEUr-SVX2eZ8EFJ46nwsjmL0LEQO21wtE Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 05:59:23.516093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e5643d28676f47869722468e73718165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e5643d28676f47869722468e73718165", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: c65f4282dd1e4f028d535b49febe12ee Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <function VolumeController.delete at 0x7f6533c8ad30> Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Volume tempest-invalid-1703287972 could not be found. Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'tempest-invalid-1703287972'} Jul 25 05:59:23.517522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1703287972 could not be found. (HTTP 404) (Request-ID: req-7bb4734d-1440-406b-9678-11c5b3c69dc1) Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:23.518294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:59:23.519788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1703287972 could not be found. Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:59:23.522543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1703287972 could not be found. Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1703287972 could not be found. Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ed328b26-e1e2-40a9-8944-61b1c631d976 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Returning 404 to user: Volume tempest-invalid-1703287972 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:23.525967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ed328b26-e1e2-40a9-8944-61b1c631d976 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1703287972" status: 404 len: 99 microversion: 2.1 time: 0.625101 Jul 25 05:59:23.539810 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 4/4] 10.222.0.40 () {58 vars in 1217 bytes} [Mon Jul 25 05:59:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1703287972 => generated 99 bytes in 646 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 05:59:23.551818 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ffdb0a82-bce9-4e1f-8d4b-5e8b1b246c12 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009706 Jul 25 05:59:23.553234 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 5/5] 10.222.0.40 () {58 vars in 1139 bytes} [Mon Jul 25 05:59:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 05:59:23.570459 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-542a0cfe-e3cb-4d5e-bf25-9d097334e93f tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007557 Jul 25 05:59:23.581286 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 6/6] 10.222.0.40 () {58 vars in 1136 bytes} [Mon Jul 25 05:59:23 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 05:59:23.591538 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-20180613-1968-4d14-8e52-93d4053e3101 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533bbc040>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:23.635248 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-20180613-1968-4d14-8e52-93d4053e3101 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] HTTP exception thrown: Volume 11fbd3f5-de01-47fc-8a14-217e5755e689 could not be found. Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-20180613-1968-4d14-8e52-93d4053e3101 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Request method failure captured: Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: DELETE /compute/v2.1/os-volumes/11fbd3f5-de01-47fc-8a14-217e5755e689 HTTP/1.1 Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jE5n4iTrYDdMLThpSwXLBp4_FaQN09vz0dbLrGbGa8zLIJ9eTNmhmIfLLUXsdCUu9PKhsaj99KJ6q_C3xUseB2ml5Rxk25p7E_NonBB3hBvPOJq_V0kWD0pwqZDYTRxisNKv_TlF-NAEIQEUr-SVX2eZ8EFJ46nwsjmL0LEQO21wtE Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 05:59:23.639262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e5643d28676f47869722468e73718165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e5643d28676f47869722468e73718165", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: c65f4282dd1e4f028d535b49febe12ee Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <function VolumeController.delete at 0x7f6533bbc040> Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Volume 11fbd3f5-de01-47fc-8a14-217e5755e689 could not be found. Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': '11fbd3f5-de01-47fc-8a14-217e5755e689'} Jul 25 05:59:23.640933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11fbd3f5-de01-47fc-8a14-217e5755e689 could not be found. (HTTP 404) (Request-ID: req-6aca4020-1043-47b0-aa5b-0be1bb9ace5b) Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:23.641876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:59:23.643206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11fbd3f5-de01-47fc-8a14-217e5755e689 could not be found. Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 05:59:23.651190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11fbd3f5-de01-47fc-8a14-217e5755e689 could not be found. Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11fbd3f5-de01-47fc-8a14-217e5755e689 could not be found. Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-20180613-1968-4d14-8e52-93d4053e3101 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Returning 404 to user: Volume 11fbd3f5-de01-47fc-8a14-217e5755e689 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-20180613-1968-4d14-8e52-93d4053e3101 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/11fbd3f5-de01-47fc-8a14-217e5755e689" status: 404 len: 109 microversion: 2.1 time: 0.062555 Jul 25 05:59:23.653228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 7/7] 10.222.0.40 () {58 vars in 1247 bytes} [Mon Jul 25 05:59:23 2022] DELETE /compute/v2.1/os-volumes/11fbd3f5-de01-47fc-8a14-217e5755e689 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:59:23.664556 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c0f4c117-0992-4bc3-950b-709504105b29 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533bbc3a0>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:23.712676 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-c0f4c117-0992-4bc3-950b-709504105b29 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] HTTP exception thrown: Volume 16218408-09c5-42c4-b15e-6e2f6c934a2c could not be found. Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c0f4c117-0992-4bc3-950b-709504105b29 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Request method failure captured: Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/os-volumes/16218408-09c5-42c4-b15e-6e2f6c934a2c HTTP/1.1 Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jE5n4iTrYDdMLThpSwXLBp4_FaQN09vz0dbLrGbGa8zLIJ9eTNmhmIfLLUXsdCUu9PKhsaj99KJ6q_C3xUseB2ml5Rxk25p7E_NonBB3hBvPOJq_V0kWD0pwqZDYTRxisNKv_TlF-NAEIQEUr-SVX2eZ8EFJ46nwsjmL0LEQO21wtE Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 05:59:23.715490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e5643d28676f47869722468e73718165"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e5643d28676f47869722468e73718165", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e5643d28676f47869722468e73718165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: e5643d28676f47869722468e73718165 Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-VolumesNegativeTest-366756684 Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: c65f4282dd1e4f028d535b49febe12ee Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-VolumesNegativeTest-366756684-project Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <function VolumeController.show at 0x7f6533bbc3a0> Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Volume 16218408-09c5-42c4-b15e-6e2f6c934a2c could not be found. Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': '16218408-09c5-42c4-b15e-6e2f6c934a2c'} Jul 25 05:59:23.717027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16218408-09c5-42c4-b15e-6e2f6c934a2c could not be found. (HTTP 404) (Request-ID: req-3d891d0a-0281-4433-a545-6b949de75e17) Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:23.717832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:59:23.718966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16218408-09c5-42c4-b15e-6e2f6c934a2c could not be found. Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 05:59:23.720101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:59:23.721224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16218408-09c5-42c4-b15e-6e2f6c934a2c could not be found. Jul 25 05:59:23.721224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.721224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:23.721224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.721224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:23.721224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:23.721224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:23.721224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:59:23.721224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:59:23.721224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16218408-09c5-42c4-b15e-6e2f6c934a2c could not be found. Jul 25 05:59:23.721224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 05:59:23.722939 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c0f4c117-0992-4bc3-950b-709504105b29 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] Returning 404 to user: Volume 16218408-09c5-42c4-b15e-6e2f6c934a2c could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:23.723991 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c0f4c117-0992-4bc3-950b-709504105b29 tempest-VolumesNegativeTest-366756684 tempest-VolumesNegativeTest-366756684-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/16218408-09c5-42c4-b15e-6e2f6c934a2c" status: 404 len: 109 microversion: 2.1 time: 0.072450 Jul 25 05:59:23.738137 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 8/8] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 05:59:23 2022] GET /compute/v2.1/os-volumes/16218408-09c5-42c4-b15e-6e2f6c934a2c => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:59:24.990372 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-41962fce-1b68-494b-9b66-78f415d918c7 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.029404 Jul 25 05:59:24.991102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 1/9] 10.222.0.40 () {60 vars in 1154 bytes} [Mon Jul 25 05:59:21 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3032 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 05:59:25.003213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e2f1d714-cb73-430a-8007-3b6fbed8ec95 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533ba4a60>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:25.109700 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e2f1d714-cb73-430a-8007-3b6fbed8ec95 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33" status: 200 len: 344 microversion: 2.1 time: 0.110083 Jul 25 05:59:25.116130 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 9/10] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 05:59:24 2022] GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33 => generated 344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:26.125079 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4a59f994-41ed-4eee-a51c-5db147407749 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533c24af0>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:26.227436 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4a59f994-41ed-4eee-a51c-5db147407749 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33" status: 200 len: 344 microversion: 2.1 time: 0.107996 Jul 25 05:59:26.228465 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 2/11] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 05:59:26 2022] GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33 => generated 344 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:27.242219 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7ffa9da4-f101-4830-98a9-7ce012f93b25 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533bbc160>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:27.378314 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7ffa9da4-f101-4830-98a9-7ce012f93b25 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33" status: 200 len: 345 microversion: 2.1 time: 0.142116 Jul 25 05:59:27.393486 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 10/12] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 05:59:27 2022] GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33 => generated 345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:27.397572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6525c904-58e5-4283-a56d-8a83d2aba748 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6533c24c10>, body: {"snapshot": {"volume_id": "f791c641-2fdc-464c-95e7-8616da51de33", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1640871017"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:28.369303 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6525c904-58e5-4283-a56d-8a83d2aba748 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.981045 Jul 25 05:59:28.383741 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a11a3cc5-d9ab-4e1e-bfc1-f08797004287 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533b53160>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:28.387702 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 3/13] 10.222.0.40 () {60 vars in 1161 bytes} [Mon Jul 25 05:59:27 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:28.514657 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a11a3cc5-d9ab-4e1e-bfc1-f08797004287 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c" status: 200 len: 287 microversion: 2.1 time: 0.135175 Jul 25 05:59:28.515499 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 11/14] 10.222.0.40 () {58 vars in 1250 bytes} [Mon Jul 25 05:59:28 2022] GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:28.527339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-03c7b636-e804-456c-9cfc-a0a8f7b8180f tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533c39790>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:28.629664 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-03c7b636-e804-456c-9cfc-a0a8f7b8180f tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.107899 Jul 25 05:59:28.630595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 4/15] 10.222.0.40 () {58 vars in 1139 bytes} [Mon Jul 25 05:59:28 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:28.641679 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e42d6369-3d70-4ea0-9fe4-2b7c699bf00d tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533b538b0>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:28.745167 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e42d6369-3d70-4ea0-9fe4-2b7c699bf00d tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c" status: 200 len: 287 microversion: 2.1 time: 0.107310 Jul 25 05:59:28.746722 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 12/16] 10.222.0.40 () {58 vars in 1250 bytes} [Mon Jul 25 05:59:28 2022] GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:29.758079 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-358b1729-25bd-4757-b97c-1148e902bcf8 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533c424c0>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:29.892431 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-358b1729-25bd-4757-b97c-1148e902bcf8 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c" status: 200 len: 287 microversion: 2.1 time: 0.131607 Jul 25 05:59:29.892431 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 5/17] 10.222.0.40 () {58 vars in 1250 bytes} [Mon Jul 25 05:59:29 2022] GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:30.899416 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e4d07e0d-a53d-407d-97ab-d80740b7d9bc tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533ba4550>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:30.955063 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e4d07e0d-a53d-407d-97ab-d80740b7d9bc tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c" status: 200 len: 287 microversion: 2.1 time: 0.060062 Jul 25 05:59:30.955632 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 13/18] 10.222.0.40 () {58 vars in 1250 bytes} [Mon Jul 25 05:59:30 2022] GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:31.969352 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4cdb3d34-049d-4bc6-8971-befbce4b3bbe tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533c24b80>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:32.039743 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4cdb3d34-049d-4bc6-8971-befbce4b3bbe tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c" status: 200 len: 288 microversion: 2.1 time: 0.076681 Jul 25 05:59:32.040648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 6/19] 10.222.0.40 () {58 vars in 1250 bytes} [Mon Jul 25 05:59:31 2022] GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c => generated 288 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:32.051693 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a56e0970-f729-4f2c-90ef-5eca9b3dfb64 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533bbcb80>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:32.277253 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a56e0970-f729-4f2c-90ef-5eca9b3dfb64 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c" status: 202 len: 0 microversion: 2.1 time: 0.227845 Jul 25 05:59:32.277253 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 14/20] 10.222.0.40 () {58 vars in 1253 bytes} [Mon Jul 25 05:59:32 2022] DELETE /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:59:32.285554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-118f9966-3a6b-4d97-a0bb-bb37ae04b50c tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533c42670>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:32.364490 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-118f9966-3a6b-4d97-a0bb-bb37ae04b50c tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c" status: 200 len: 287 microversion: 2.1 time: 0.082953 Jul 25 05:59:32.365276 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 7/21] 10.222.0.40 () {58 vars in 1250 bytes} [Mon Jul 25 05:59:32 2022] GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:33.377505 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9427ffbb-89da-4596-bc13-df5b74b71b6c tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533bbc160>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:33.458589 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9427ffbb-89da-4596-bc13-df5b74b71b6c tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c" status: 200 len: 287 microversion: 2.1 time: 0.085110 Jul 25 05:59:33.459433 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 15/22] 10.222.0.40 () {58 vars in 1250 bytes} [Mon Jul 25 05:59:33 2022] GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 05:59:34.069611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0b8b3cb0-84d9-4e41-9203-6ea5973512f3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6533c428b0>, body: {"keypair": {"name": "tempest-keypair-394870169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkQWvJE56feIDQB4O7ZOvSiW9sPrZZRzSxc37jUzRv2QHKUZ6i2Z/PfS6LlRP9U6z/2OJZqG6n4tu0NOTmL3wjiJrMvYuDOQaNuYKEI4HSRQHjijiOC+fEocTvTAMqw6A=="}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:34.234649 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-0b8b3cb0-84d9-4e41-9203-6ea5973512f3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Getting quotas for project 5ea60662f93343019fe380b6e13d5d18. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:34.245020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-0b8b3cb0-84d9-4e41-9203-6ea5973512f3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Getting quotas for user a7224418acee432182bf3195bfc8fd99 and project 5ea60662f93343019fe380b6e13d5d18. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:34.453078 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0b8b3cb0-84d9-4e41-9203-6ea5973512f3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.613346 Jul 25 05:59:34.454201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 8/23] 10.222.0.40 () {60 vars in 1158 bytes} [Mon Jul 25 05:59:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:34.471704 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d3df82d7-0a55-4acc-b946-333c284b4352 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6534603ee0>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:34.535608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d3df82d7-0a55-4acc-b946-333c284b4352 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c" status: 200 len: 287 microversion: 2.1 time: 0.068201 Jul 25 05:59:34.536226 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 16/24] 10.222.0.40 () {58 vars in 1250 bytes} [Mon Jul 25 05:59:34 2022] GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:35.549073 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7f45eaa9-0fb0-4db5-a18b-9448be69fe57 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533c0ef70>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:35.640725 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-7f45eaa9-0fb0-4db5-a18b-9448be69fe57 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] HTTP exception thrown: Snapshot d8eba48d-9162-49b1-9560-e104d20ccf1c could not be found. Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7f45eaa9-0fb0-4db5-a18b-9448be69fe57 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Request method failure captured: Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c HTTP/1.1 Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jE5Xsl4SPx8-Me4Ai4h0GqBkt-G4c7lgizfo33xRxbgmLPydAFCcWgmB4Ujw9XkzALH5jjIObs3QYi2ZiyHyPktYApYvvu45OcUVsgMw1Dwl_jGjLNfo3xQV7rpoPIhkWuTIwHH3Ia4y1AyrQQ_mhVGSDaEgEITxm1HsbI8kYmf7ZQ Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: ab084e94980d4f1abb02c9bf6fc50b74 Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 05:59:35.646989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ab084e94980d4f1abb02c9bf6fc50b74", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: ab084e94980d4f1abb02c9bf6fc50b74 Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-VolumesSnapshotsTestJSON-918928787-project Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: e4807ff3644549529906d7f2fa9d5cbe Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-VolumesSnapshotsTestJSON-918928787-project Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <function SnapshotController.show at 0x7f6533c0ef70> Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Snapshot d8eba48d-9162-49b1-9560-e104d20ccf1c could not be found. Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'd8eba48d-9162-49b1-9560-e104d20ccf1c'} Jul 25 05:59:35.647981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d8eba48d-9162-49b1-9560-e104d20ccf1c could not be found. (HTTP 404) (Request-ID: req-7ff5fbd0-7ea7-42d3-b480-b9369f1cbe2c) Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:35.648994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:59:35.649824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d8eba48d-9162-49b1-9560-e104d20ccf1c could not be found. Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 05:59:35.653055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:59:35.655374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d8eba48d-9162-49b1-9560-e104d20ccf1c could not be found. Jul 25 05:59:35.655374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:35.655374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:35.655374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:35.655374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:35.655374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:35.655374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:35.655374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:59:35.655374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:59:35.655374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d8eba48d-9162-49b1-9560-e104d20ccf1c could not be found. Jul 25 05:59:35.655374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:35.659129 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7f45eaa9-0fb0-4db5-a18b-9448be69fe57 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Returning 404 to user: Snapshot d8eba48d-9162-49b1-9560-e104d20ccf1c could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:35.660278 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7f45eaa9-0fb0-4db5-a18b-9448be69fe57 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c" status: 404 len: 111 microversion: 2.1 time: 0.116189 Jul 25 05:59:35.661914 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 9/25] 10.222.0.40 () {58 vars in 1250 bytes} [Mon Jul 25 05:59:35 2022] GET /compute/v2.1/os-snapshots/d8eba48d-9162-49b1-9560-e104d20ccf1c => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 05:59:35.669600 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b1d8c49b-ba0e-4f5b-adf7-62e28a53fb5f tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533bbc160>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:36.115279 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b1d8c49b-ba0e-4f5b-adf7-62e28a53fb5f tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33" status: 202 len: 0 microversion: 2.1 time: 0.449910 Jul 25 05:59:36.116074 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 17/26] 10.222.0.40 () {58 vars in 1247 bytes} [Mon Jul 25 05:59:35 2022] DELETE /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 05:59:36.127512 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-31ad5288-1f2f-479f-b8b8-84c03cbb9316 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f65345bb160>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:36.342836 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-31ad5288-1f2f-479f-b8b8-84c03cbb9316 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33" status: 200 len: 344 microversion: 2.1 time: 0.220962 Jul 25 05:59:36.343401 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 10/27] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 05:59:36 2022] GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:37.360982 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2d81336f-33a0-440d-8a8d-20900fea8e0a tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533c0eaf0>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:37.423694 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-557828004", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "networks": [{"uuid": "0d15383e-d6bc-440c-8878-9fb1b58b4e6c"}]}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:37.441704 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-2d81336f-33a0-440d-8a8d-20900fea8e0a tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] HTTP exception thrown: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2d81336f-33a0-440d-8a8d-20900fea8e0a tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Request method failure captured: Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33 HTTP/1.1 Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jE5Xsl4SPx8-Me4Ai4h0GqBkt-G4c7lgizfo33xRxbgmLPydAFCcWgmB4Ujw9XkzALH5jjIObs3QYi2ZiyHyPktYApYvvu45OcUVsgMw1Dwl_jGjLNfo3xQV7rpoPIhkWuTIwHH3Ia4y1AyrQQ_mhVGSDaEgEITxm1HsbI8kYmf7ZQ Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: ab084e94980d4f1abb02c9bf6fc50b74 Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 05:59:37.444100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ab084e94980d4f1abb02c9bf6fc50b74", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: ab084e94980d4f1abb02c9bf6fc50b74 Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-VolumesSnapshotsTestJSON-918928787-project Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: e4807ff3644549529906d7f2fa9d5cbe Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-VolumesSnapshotsTestJSON-918928787-project Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <function VolumeController.show at 0x7f6533c0eaf0> Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'f791c641-2fdc-464c-95e7-8616da51de33'} Jul 25 05:59:37.445500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. (HTTP 404) (Request-ID: req-4c277438-4281-48a4-9fff-881c169346aa) Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:37.446283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:59:37.447356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 05:59:37.448583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2d81336f-33a0-440d-8a8d-20900fea8e0a tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Returning 404 to user: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2d81336f-33a0-440d-8a8d-20900fea8e0a tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33" status: 404 len: 109 microversion: 2.1 time: 0.094858 Jul 25 05:59:37.449680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 11/28] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 05:59:37 2022] GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 05:59:37.467569 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8cac5cfa-5780-4e55-a620-e17d9343a9d0 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f653333e3a0>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:37.564177 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-8cac5cfa-5780-4e55-a620-e17d9343a9d0 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] HTTP exception thrown: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8cac5cfa-5780-4e55-a620-e17d9343a9d0 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Request method failure captured: Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: DELETE /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33 HTTP/1.1 Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jE5Xsl4SPx8-Me4Ai4h0GqBkt-G4c7lgizfo33xRxbgmLPydAFCcWgmB4Ujw9XkzALH5jjIObs3QYi2ZiyHyPktYApYvvu45OcUVsgMw1Dwl_jGjLNfo3xQV7rpoPIhkWuTIwHH3Ia4y1AyrQQ_mhVGSDaEgEITxm1HsbI8kYmf7ZQ Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: ab084e94980d4f1abb02c9bf6fc50b74 Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 05:59:37.567055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ab084e94980d4f1abb02c9bf6fc50b74", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: ab084e94980d4f1abb02c9bf6fc50b74 Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-VolumesSnapshotsTestJSON-918928787-project Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: e4807ff3644549529906d7f2fa9d5cbe Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-VolumesSnapshotsTestJSON-918928787-project Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <function VolumeController.delete at 0x7f653333e3a0> Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'f791c641-2fdc-464c-95e7-8616da51de33'} Jul 25 05:59:37.568685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. (HTTP 404) (Request-ID: req-5cfa8bcc-4d43-41fe-b30b-592b00907041) Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:37.569483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 05:59:37.570544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 05:59:37.571627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8cac5cfa-5780-4e55-a620-e17d9343a9d0 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Returning 404 to user: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8cac5cfa-5780-4e55-a620-e17d9343a9d0 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33" status: 404 len: 109 microversion: 2.1 time: 0.118698 Jul 25 05:59:37.577954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 12/29] 10.222.0.40 () {58 vars in 1247 bytes} [Mon Jul 25 05:59:37 2022] DELETE /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 05:59:37.637041 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1d73897e-0f05-44da-ada8-58395dfdc197 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6533c0ea60>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:37.740630 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] validate_networks() for [('0d15383e-d6bc-440c-8878-9fb1b58b4e6c', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:59:37.752507 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-1d73897e-0f05-44da-ada8-58395dfdc197 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] HTTP exception thrown: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1d73897e-0f05-44da-ada8-58395dfdc197 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Request method failure captured: Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33 HTTP/1.1 Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jE5Xsl4SPx8-Me4Ai4h0GqBkt-G4c7lgizfo33xRxbgmLPydAFCcWgmB4Ujw9XkzALH5jjIObs3QYi2ZiyHyPktYApYvvu45OcUVsgMw1Dwl_jGjLNfo3xQV7rpoPIhkWuTIwHH3Ia4y1AyrQQ_mhVGSDaEgEITxm1HsbI8kYmf7ZQ Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: ab084e94980d4f1abb02c9bf6fc50b74 Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 05:59:37.757095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ab084e94980d4f1abb02c9bf6fc50b74", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ab084e94980d4f1abb02c9bf6fc50b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: ab084e94980d4f1abb02c9bf6fc50b74 Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-918928787 Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-VolumesSnapshotsTestJSON-918928787-project Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: e4807ff3644549529906d7f2fa9d5cbe Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-VolumesSnapshotsTestJSON-918928787-project Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <function VolumeController.show at 0x7f6533c0ea60> Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'f791c641-2fdc-464c-95e7-8616da51de33'} Jul 25 05:59:37.758510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. (HTTP 404) (Request-ID: req-f67b0d6a-c09d-4da2-b86a-3ffd39c23503) Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:37.759258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 05:59:37.760522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 05:59:37.761572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 05:59:37.762687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.762687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.762687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 05:59:37.762687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.762687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 05:59:37.762687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 05:59:37.762687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 05:59:37.762687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 05:59:37.762687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 05:59:37.762687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. Jul 25 05:59:37.762687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 05:59:37.764873 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1d73897e-0f05-44da-ada8-58395dfdc197 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] Returning 404 to user: Volume f791c641-2fdc-464c-95e7-8616da51de33 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 05:59:37.765876 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1d73897e-0f05-44da-ada8-58395dfdc197 tempest-VolumesSnapshotsTestJSON-918928787 tempest-VolumesSnapshotsTestJSON-918928787-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33" status: 404 len: 109 microversion: 2.1 time: 0.185892 Jul 25 05:59:37.766873 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 13/30] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 05:59:37 2022] GET /compute/v2.1/os-volumes/f791c641-2fdc-464c-95e7-8616da51de33 => generated 109 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 05:59:39.479361 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8951dd10-cd46-4384-98b5-063d0af18299 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6533c0eca0>, body: {"keypair": {"name": "tempest-keypair-716786813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2YL1CJt6FOciFxabn2zj4UKvTavlet1ZJeMdlyc/y2e0A9lc5nSupEt+QmtRh8ByeIu1YxU7a46G/+SKa95Nd7S+p2klLzcWFBq3T+CJj8kkdE05QUSysTAdL8gPQ1TQ=="}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:39.517712 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-8951dd10-cd46-4384-98b5-063d0af18299 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:39.541125 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-8951dd10-cd46-4384-98b5-063d0af18299 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for user 8eedefd8d94047478663ceab8962d738 and project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:39.704043 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8951dd10-cd46-4384-98b5-063d0af18299 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.545051 Jul 25 05:59:39.710879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 14/31] 10.222.0.40 () {60 vars in 1158 bytes} [Mon Jul 25 05:59:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 05:59:40.784971 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:59:40.785730 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:59:40.786222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:59:40.786636 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:59:40.787693 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:59:40.811737 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:40.812437 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:40.813079 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5e9f63fc-b468-4e86-832c-b799b0cde348 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f653333e280>, body: {"keypair": {"name": "tempest-keypair-597729569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAYat4WUJX++IvzVm6GRNli/o83fFBR/lVa7TKbHdxq+h0S6/BIOY6PgKWmbS3yTOVS3q0as2krQ19FuksdcwJzCUWvs5exwrSJesAIkBlSuDBxKrGvhE7zBORuKQNc/A=="}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:40.814254 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:40.815226 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:40.850222 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-5e9f63fc-b468-4e86-832c-b799b0cde348 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Getting quotas for project 1871c9af781743f5af1d92371a42ecf1. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:40.858967 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-5e9f63fc-b468-4e86-832c-b799b0cde348 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Getting quotas for user d485f9fc38a442dd9e1528024460fcca and project 1871c9af781743f5af1d92371a42ecf1. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:40.897856 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Getting quotas for project 1484746571a24f5db36ed027469f88c1. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:40.910652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Getting quotas for user db1a33dc0f174cb1bdebf9e0c710509d and project 1484746571a24f5db36ed027469f88c1. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:40.949030 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:59:40.955226 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:59:40.989248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5e9f63fc-b468-4e86-832c-b799b0cde348 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.323536 Jul 25 05:59:40.994063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 15/32] 10.222.0.40 () {62 vars in 1199 bytes} [Mon Jul 25 05:59:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 329 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 05:59:41.224571 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-649babc4-0664-4b53-900b-7959a44822d2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.928014 Jul 25 05:59:41.225872 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 18/33] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 05:59:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:59:41.235907 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-83987398-eb28-470e-b254-9f6ed496a06a tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:41.238308 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-83987398-eb28-470e-b254-9f6ed496a06a tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:41.480217 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-83987398-eb28-470e-b254-9f6ed496a06a tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:41.496341 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-83987398-eb28-470e-b254-9f6ed496a06a tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1214 microversion: 2.1 time: 0.264128 Jul 25 05:59:41.497535 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 16/34] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:41 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:41.671207 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-135723317", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:41.813988 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] validate_networks() for [('aa79d0fe-56b1-4e97-990f-ad8f32170783', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:59:42.515576 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-62d60387-562c-4e5c-b7ad-857577e9b732 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:42.517181 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-62d60387-562c-4e5c-b7ad-857577e9b732 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:42.710967 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-62d60387-562c-4e5c-b7ad-857577e9b732 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:42.723462 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-62d60387-562c-4e5c-b7ad-857577e9b732 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1214 microversion: 2.1 time: 0.213844 Jul 25 05:59:42.734625 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 17/35] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:42 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:43.266956 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:59:43.268093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:59:43.268883 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:59:43.269510 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:59:43.270137 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:59:43.286563 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:43.287272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:43.288990 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:43.289661 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:43.333075 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Getting quotas for project 07562543fa3e40d584b4d4525b112319. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:43.350037 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Getting quotas for user 62e566aa74b045cb8cc6e8edf4a256e1 and project 07562543fa3e40d584b4d4525b112319. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:43.387902 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:59:43.395483 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:59:43.582128 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-34287c16-1291-46ac-8f83-afe52b114746 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.274682 Jul 25 05:59:43.583649 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 19/36] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 05:59:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:59:43.597723 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-24f8ca6d-d39f-49f5-a97b-4600b6e76fe5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:43.600145 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-24f8ca6d-d39f-49f5-a97b-4600b6e76fe5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:43.646077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-241290655", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8aa6446-1bfa-4069-a27c-c14f749ca6da"}], "security_groups": [{"name": "tempest-securitygroup--1664195889"}], "key_name": "tempest-keypair-394870169", "user_data": "}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:43.827561 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-24f8ca6d-d39f-49f5-a97b-4600b6e76fe5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:43.836404 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-24f8ca6d-d39f-49f5-a97b-4600b6e76fe5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1221 microversion: 2.1 time: 0.245342 Jul 25 05:59:43.839827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 18/37] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:43 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1221 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:43.845688 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c102714f-5a8a-4852-88dc-5f40bbec07b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:43.852145 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c102714f-5a8a-4852-88dc-5f40bbec07b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:43.993309 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c102714f-5a8a-4852-88dc-5f40bbec07b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:44.012566 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c102714f-5a8a-4852-88dc-5f40bbec07b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1214 microversion: 2.1 time: 0.171263 Jul 25 05:59:44.019093 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 19/38] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:43 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:44.179922 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] validate_networks() for [('e8aa6446-1bfa-4069-a27c-c14f749ca6da', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:59:44.378827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5c4c0>>, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2042661631", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:44.570603 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.network.neutron [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] validate_networks() for [('aa79d0fe-56b1-4e97-990f-ad8f32170783', None, None, None, None, None)] {{(pid=124918) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:59:45.941893 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:59:45.942460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:59:45.943037 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:59:45.943453 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:59:45.943871 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:59:45.974389 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:45.975078 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:45.975902 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:45.976403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:46.033992 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Getting quotas for project 5ea60662f93343019fe380b6e13d5d18. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:46.052250 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Getting quotas for user a7224418acee432182bf3195bfc8fd99 and project 5ea60662f93343019fe380b6e13d5d18. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:46.081929 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:59:46.085634 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:59:46.263087 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f4c88c57-645a-4e58-b9d0-51379281acf4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.614908 Jul 25 05:59:46.264708 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 20/39] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 05:59:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 2624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:59:46.270487 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e5f12afe-b7dd-4f1b-a76e-51194c346d8c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:46.300702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e5f12afe-b7dd-4f1b-a76e-51194c346d8c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:46.347757 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5f12afe-b7dd-4f1b-a76e-51194c346d8c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:46.348885 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5f12afe-b7dd-4f1b-a76e-51194c346d8c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:46.350529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5f12afe-b7dd-4f1b-a76e-51194c346d8c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:46.351657 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5f12afe-b7dd-4f1b-a76e-51194c346d8c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:46.542869 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Flavor limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:59:46.544442 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Image limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:59:46.545131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Flavor pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:59:46.545734 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Image pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:59:46.546345 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:59:46.598413 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:46.598413 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:46.598413 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:46.598413 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:46.708636 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Getting quotas for project 07562543fa3e40d584b4d4525b112319. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:46.722768 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Getting quotas for user 62e566aa74b045cb8cc6e8edf4a256e1 and project 07562543fa3e40d584b4d4525b112319. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:46.785672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Going to run 1 instances... {{(pid=124918) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:59:46.810886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:59:46.862000 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e5f12afe-b7dd-4f1b-a76e-51194c346d8c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:46.891838 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e5f12afe-b7dd-4f1b-a76e-51194c346d8c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1274 microversion: 2.1 time: 0.625756 Jul 25 05:59:46.914421 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 21/40] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:46 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1274 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:46.922232 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-850277580", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d80cb7ca-3031-41c9-afe8-b6a4faf27141"}], "security_groups": [{"name": "tempest-securitygroup--2093880513"}], "key_name": "tempest-keypair-716786813", "user_data": "}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:47.129865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-11b4e381-7405-4916-80a2-83d2983eca75 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.761281 Jul 25 05:59:47.138222 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 05:59:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:59:47.160311 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b71d3d00-1b0d-4a62-b992-1e253469060f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:47.160311 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b71d3d00-1b0d-4a62-b992-1e253469060f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:47.303901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b71d3d00-1b0d-4a62-b992-1e253469060f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:47.319987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b71d3d00-1b0d-4a62-b992-1e253469060f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1236 microversion: 2.1 time: 0.180044 Jul 25 05:59:47.337295 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 21/42] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:47 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1236 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:47.377469 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a4c21db6-8cb8-42db-a25a-eb8bfdee7e71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:47.379421 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a4c21db6-8cb8-42db-a25a-eb8bfdee7e71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:47.448912 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] validate_networks() for [('d80cb7ca-3031-41c9-afe8-b6a4faf27141', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:59:47.469409 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a4c21db6-8cb8-42db-a25a-eb8bfdee7e71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:47.477403 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a4c21db6-8cb8-42db-a25a-eb8bfdee7e71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1222 microversion: 2.1 time: 0.138155 Jul 25 05:59:47.479187 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 22/43] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:47 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1222 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:47.928985 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3471cde9-b0b7-47f2-bc61-4d02df0a14a3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:47.930672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3471cde9-b0b7-47f2-bc61-4d02df0a14a3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:47.952373 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3471cde9-b0b7-47f2-bc61-4d02df0a14a3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:47.968392 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3471cde9-b0b7-47f2-bc61-4d02df0a14a3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:47.974795 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3471cde9-b0b7-47f2-bc61-4d02df0a14a3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:47.975452 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3471cde9-b0b7-47f2-bc61-4d02df0a14a3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:48.286345 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3471cde9-b0b7-47f2-bc61-4d02df0a14a3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:48.301040 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3471cde9-b0b7-47f2-bc61-4d02df0a14a3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1272 microversion: 2.1 time: 0.381557 Jul 25 05:59:48.302489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 23/44] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:47 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:48.341971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2f983608-ca21-4de6-83c5-9b80787571d5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:48.342703 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2f983608-ca21-4de6-83c5-9b80787571d5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:48.351367 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f983608-ca21-4de6-83c5-9b80787571d5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:48.351985 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f983608-ca21-4de6-83c5-9b80787571d5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:48.356756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f983608-ca21-4de6-83c5-9b80787571d5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:48.356756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f983608-ca21-4de6-83c5-9b80787571d5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:48.457154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2f983608-ca21-4de6-83c5-9b80787571d5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:48.468458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2f983608-ca21-4de6-83c5-9b80787571d5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1240 microversion: 2.1 time: 0.133422 Jul 25 05:59:48.480029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 24/45] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:48 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1240 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:48.497727 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6a848fd9-460d-46bd-a242-aeb052fc3ce2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:48.501167 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6a848fd9-460d-46bd-a242-aeb052fc3ce2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:48.700444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6a848fd9-460d-46bd-a242-aeb052fc3ce2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:48.708854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6a848fd9-460d-46bd-a242-aeb052fc3ce2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1222 microversion: 2.1 time: 0.216301 Jul 25 05:59:48.710400 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 25/46] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:48 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:49.199809 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5c4c0>>, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-624717608", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d09a72ec-f4c1-4494-ae4f-e65cd0316aed"}], "security_groups": [{"name": "tempest-securitygroup--1332234678"}], "key_name": "tempest-keypair-597729569", "user_data": "}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 05:59:49.524869 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.network.neutron [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] validate_networks() for [('d09a72ec-f4c1-4494-ae4f-e65cd0316aed', None, None, None, None, None)] {{(pid=124918) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 05:59:49.668884 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:59:49.669641 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:59:49.670778 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:59:49.671723 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:59:49.672492 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:59:49.705681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:49.706546 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:49.707589 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:49.708421 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:49.778913 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:49.791499 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for user 8eedefd8d94047478663ceab8962d738 and project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:49.825750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:59:49.828005 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:59:50.109222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4ec9146b-59a1-4fa9-9d1d-f4ab4ff7ccba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.202914 Jul 25 05:59:50.116355 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 22/47] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 05:59:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 3210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 05:59:50.136057 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f8e1d037-7e3b-40d5-a5cd-56b8d01a0ad4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:50.137877 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f8e1d037-7e3b-40d5-a5cd-56b8d01a0ad4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:50.168674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f8e1d037-7e3b-40d5-a5cd-56b8d01a0ad4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:50.169637 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f8e1d037-7e3b-40d5-a5cd-56b8d01a0ad4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:50.170746 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f8e1d037-7e3b-40d5-a5cd-56b8d01a0ad4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:50.171428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f8e1d037-7e3b-40d5-a5cd-56b8d01a0ad4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:50.622034 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Flavor limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 05:59:50.623282 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Image limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 05:59:50.624024 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Flavor pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 05:59:50.625112 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Image pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 05:59:50.625946 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 05:59:50.644456 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:50.650258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:50.658621 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:50.661987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:50.703317 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Getting quotas for project 1871c9af781743f5af1d92371a42ecf1. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 05:59:50.844882 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Getting quotas for user d485f9fc38a442dd9e1528024460fcca and project 1871c9af781743f5af1d92371a42ecf1. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 05:59:50.844882 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Going to run 1 instances... {{(pid=124918) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 05:59:50.844882 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 05:59:50.844882 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:50.845340 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f8e1d037-7e3b-40d5-a5cd-56b8d01a0ad4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:50.845340 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f8e1d037-7e3b-40d5-a5cd-56b8d01a0ad4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1272 microversion: 2.1 time: 0.690605 Jul 25 05:59:50.845340 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 23/48] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:50 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1272 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:50.845340 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-75767891-6803-47be-b8fd-dec004638b4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:50.846077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-75767891-6803-47be-b8fd-dec004638b4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:50.846077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75767891-6803-47be-b8fd-dec004638b4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:50.846077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75767891-6803-47be-b8fd-dec004638b4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:50.846077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75767891-6803-47be-b8fd-dec004638b4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:50.846338 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75767891-6803-47be-b8fd-dec004638b4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:51.032614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-75767891-6803-47be-b8fd-dec004638b4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:51.032614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-75767891-6803-47be-b8fd-dec004638b4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1296 microversion: 2.1 time: 0.191926 Jul 25 05:59:51.032614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 24/49] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:50 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1296 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:51.032614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c482d0ad-0797-442a-8c11-1bc6faa9a6e4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:51.033625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c482d0ad-0797-442a-8c11-1bc6faa9a6e4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:51.033625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c482d0ad-0797-442a-8c11-1bc6faa9a6e4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:51.033625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c482d0ad-0797-442a-8c11-1bc6faa9a6e4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:51.033625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c482d0ad-0797-442a-8c11-1bc6faa9a6e4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:51.034210 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c482d0ad-0797-442a-8c11-1bc6faa9a6e4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:51.124844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e3b640a5-4750-413e-b6b9-b8f989c0fada tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.928598 Jul 25 05:59:51.177225 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 26/50] 10.222.0.40 () {62 vars in 1187 bytes} [Mon Jul 25 05:59:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1981 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 25 05:59:51.207264 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a43ddcd6-41cd-42fc-adb7-21eb06c70315 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:51.207397 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c482d0ad-0797-442a-8c11-1bc6faa9a6e4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:51.221669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c482d0ad-0797-442a-8c11-1bc6faa9a6e4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1274 microversion: 2.1 time: 0.211846 Jul 25 05:59:51.222498 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 25/51] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:51 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1274 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:51.232527 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a43ddcd6-41cd-42fc-adb7-21eb06c70315 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:51.237305 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7b199a8d-e21c-4d3c-a549-8008a8424789 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:51.238347 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7b199a8d-e21c-4d3c-a549-8008a8424789 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:51.457426 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a43ddcd6-41cd-42fc-adb7-21eb06c70315 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:51.469381 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a43ddcd6-41cd-42fc-adb7-21eb06c70315 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1240 microversion: 2.1 time: 0.276083 Jul 25 05:59:51.487614 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 27/52] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:51 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1240 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:51.841751 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9fa7b0ef-414e-412f-b017-3281243b8dd9 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:51.843304 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9fa7b0ef-414e-412f-b017-3281243b8dd9 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:51.863082 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9fa7b0ef-414e-412f-b017-3281243b8dd9 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:51.863235 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9fa7b0ef-414e-412f-b017-3281243b8dd9 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:51.885660 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9fa7b0ef-414e-412f-b017-3281243b8dd9 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:51.886233 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9fa7b0ef-414e-412f-b017-3281243b8dd9 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:52.188142 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7b199a8d-e21c-4d3c-a549-8008a8424789 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:52.230064 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7b199a8d-e21c-4d3c-a549-8008a8424789 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:52.241768 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7b199a8d-e21c-4d3c-a549-8008a8424789 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:52.248401 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7b199a8d-e21c-4d3c-a549-8008a8424789 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1280 microversion: 2.20 time: 1.017757 Jul 25 05:59:52.257732 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 26/53] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:51 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1280 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:52.289348 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6cc5ad83-179b-4d30-bcdc-bd885eb28a1f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:52.290149 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6cc5ad83-179b-4d30-bcdc-bd885eb28a1f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:52.315336 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cc5ad83-179b-4d30-bcdc-bd885eb28a1f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:52.315336 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cc5ad83-179b-4d30-bcdc-bd885eb28a1f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:52.331411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cc5ad83-179b-4d30-bcdc-bd885eb28a1f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:52.332273 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cc5ad83-179b-4d30-bcdc-bd885eb28a1f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:52.845230 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6cc5ad83-179b-4d30-bcdc-bd885eb28a1f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:52.859360 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6cc5ad83-179b-4d30-bcdc-bd885eb28a1f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1294 microversion: 2.1 time: 0.600945 Jul 25 05:59:52.863097 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 27/54] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:52 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1294 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:52.898151 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-60208931-82bf-4562-b1fe-55dfd93d3b62 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:52.900618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-60208931-82bf-4562-b1fe-55dfd93d3b62 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:52.940490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60208931-82bf-4562-b1fe-55dfd93d3b62 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:52.941139 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60208931-82bf-4562-b1fe-55dfd93d3b62 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:52.944183 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60208931-82bf-4562-b1fe-55dfd93d3b62 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:52.944642 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60208931-82bf-4562-b1fe-55dfd93d3b62 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:53.040902 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9fa7b0ef-414e-412f-b017-3281243b8dd9 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:53.052158 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9fa7b0ef-414e-412f-b017-3281243b8dd9 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 1.215166 Jul 25 05:59:53.055733 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 28/55] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:51 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:53.074079 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-112ecfdd-cd46-411e-bb6c-c11c29118394 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:53.076889 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-112ecfdd-cd46-411e-bb6c-c11c29118394 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:53.104835 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-112ecfdd-cd46-411e-bb6c-c11c29118394 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:53.105294 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-112ecfdd-cd46-411e-bb6c-c11c29118394 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:53.107380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-112ecfdd-cd46-411e-bb6c-c11c29118394 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:53.107833 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-112ecfdd-cd46-411e-bb6c-c11c29118394 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:53.220518 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-60208931-82bf-4562-b1fe-55dfd93d3b62 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:53.229656 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-60208931-82bf-4562-b1fe-55dfd93d3b62 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1280 microversion: 2.1 time: 0.365039 Jul 25 05:59:53.230269 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 28/56] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:52 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1280 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:53.267129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7aa9d5cf-e324-4102-9988-7727e896de8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:53.267758 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7aa9d5cf-e324-4102-9988-7727e896de8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:53.279253 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7aa9d5cf-e324-4102-9988-7727e896de8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:53.279790 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7aa9d5cf-e324-4102-9988-7727e896de8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:53.282451 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7aa9d5cf-e324-4102-9988-7727e896de8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:53.293804 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7aa9d5cf-e324-4102-9988-7727e896de8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:53.300466 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-112ecfdd-cd46-411e-bb6c-c11c29118394 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:53.318460 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-112ecfdd-cd46-411e-bb6c-c11c29118394 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1236 microversion: 2.1 time: 0.258833 Jul 25 05:59:53.319056 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 29/57] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:53 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1236 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:53.399375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7aa9d5cf-e324-4102-9988-7727e896de8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:53.415829 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7aa9d5cf-e324-4102-9988-7727e896de8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:53.415829 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7aa9d5cf-e324-4102-9988-7727e896de8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:53.415829 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7aa9d5cf-e324-4102-9988-7727e896de8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1284 microversion: 2.20 time: 0.152064 Jul 25 05:59:53.416536 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 29/58] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:53 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 05:59:53.894257 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-97e87334-7bfe-4d6b-bd4b-f69d089c10b3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:53.896401 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-97e87334-7bfe-4d6b-bd4b-f69d089c10b3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:53.915646 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-97e87334-7bfe-4d6b-bd4b-f69d089c10b3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:53.921113 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-97e87334-7bfe-4d6b-bd4b-f69d089c10b3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:53.922248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-97e87334-7bfe-4d6b-bd4b-f69d089c10b3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:53.922861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-97e87334-7bfe-4d6b-bd4b-f69d089c10b3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.074476 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-521a07f8-2dd9-456e-b193-31254e613b81 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:54.075423 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-521a07f8-2dd9-456e-b193-31254e613b81 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:54.086579 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-521a07f8-2dd9-456e-b193-31254e613b81 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:54.088304 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-521a07f8-2dd9-456e-b193-31254e613b81 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.090173 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-521a07f8-2dd9-456e-b193-31254e613b81 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:54.090897 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-521a07f8-2dd9-456e-b193-31254e613b81 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.136791 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-97e87334-7bfe-4d6b-bd4b-f69d089c10b3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:54.152251 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-97e87334-7bfe-4d6b-bd4b-f69d089c10b3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.273274 Jul 25 05:59:54.157012 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 30/59] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:53 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:54.273942 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6b02848e-2bd4-4488-90d3-51e8c16b238a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:54.275537 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6b02848e-2bd4-4488-90d3-51e8c16b238a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:54.309971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b02848e-2bd4-4488-90d3-51e8c16b238a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:54.310734 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b02848e-2bd4-4488-90d3-51e8c16b238a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.312719 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b02848e-2bd4-4488-90d3-51e8c16b238a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:54.313326 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b02848e-2bd4-4488-90d3-51e8c16b238a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.353251 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-521a07f8-2dd9-456e-b193-31254e613b81 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:54.364680 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-521a07f8-2dd9-456e-b193-31254e613b81 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.295328 Jul 25 05:59:54.365579 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 30/60] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:54 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:54.379746 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-cce5c665-6783-452e-91b9-064e7d6fd8ac tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:54.386132 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cce5c665-6783-452e-91b9-064e7d6fd8ac tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:54.413760 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cce5c665-6783-452e-91b9-064e7d6fd8ac tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:54.413760 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cce5c665-6783-452e-91b9-064e7d6fd8ac tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.413760 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cce5c665-6783-452e-91b9-064e7d6fd8ac tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:54.413760 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cce5c665-6783-452e-91b9-064e7d6fd8ac tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.559522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-cce5c665-6783-452e-91b9-064e7d6fd8ac tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:54.571650 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6b02848e-2bd4-4488-90d3-51e8c16b238a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:54.577280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-cce5c665-6783-452e-91b9-064e7d6fd8ac tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1236 microversion: 2.1 time: 0.210577 Jul 25 05:59:54.578527 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 31/61] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:54 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1236 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:54.580284 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6b02848e-2bd4-4488-90d3-51e8c16b238a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.336520 Jul 25 05:59:54.594144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 31/62] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:54 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:54.594932 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3ec7c366-56f8-42dd-9cda-616cc41900b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:54.595617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3ec7c366-56f8-42dd-9cda-616cc41900b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:54.607077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ec7c366-56f8-42dd-9cda-616cc41900b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:54.607558 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ec7c366-56f8-42dd-9cda-616cc41900b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.608389 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ec7c366-56f8-42dd-9cda-616cc41900b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:54.609372 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ec7c366-56f8-42dd-9cda-616cc41900b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:54.693710 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3ec7c366-56f8-42dd-9cda-616cc41900b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:54.703275 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3ec7c366-56f8-42dd-9cda-616cc41900b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:54.705079 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3ec7c366-56f8-42dd-9cda-616cc41900b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:54.706234 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3ec7c366-56f8-42dd-9cda-616cc41900b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1284 microversion: 2.20 time: 0.126556 Jul 25 05:59:54.706812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 32/63] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:54 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:55.173141 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2e184d18-f8d1-409a-a174-e67deb96dafa tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:55.173981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2e184d18-f8d1-409a-a174-e67deb96dafa tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:55.183706 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2e184d18-f8d1-409a-a174-e67deb96dafa tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.184448 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2e184d18-f8d1-409a-a174-e67deb96dafa tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.185459 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2e184d18-f8d1-409a-a174-e67deb96dafa tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.186047 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2e184d18-f8d1-409a-a174-e67deb96dafa tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.388252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3a411c0d-0d2b-441f-9b3a-13337d08ad70 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:55.388252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3a411c0d-0d2b-441f-9b3a-13337d08ad70 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:55.401000 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a411c0d-0d2b-441f-9b3a-13337d08ad70 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.401932 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a411c0d-0d2b-441f-9b3a-13337d08ad70 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.422637 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a411c0d-0d2b-441f-9b3a-13337d08ad70 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.424900 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a411c0d-0d2b-441f-9b3a-13337d08ad70 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.504701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2e184d18-f8d1-409a-a174-e67deb96dafa tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:55.518291 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2e184d18-f8d1-409a-a174-e67deb96dafa tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.345862 Jul 25 05:59:55.520155 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 32/64] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:55 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:55.595346 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3af3702d-7abf-4a04-93ce-c8b41715db2e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:55.596461 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3af3702d-7abf-4a04-93ce-c8b41715db2e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:55.609806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3af3702d-7abf-4a04-93ce-c8b41715db2e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.613737 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3af3702d-7abf-4a04-93ce-c8b41715db2e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.616239 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3af3702d-7abf-4a04-93ce-c8b41715db2e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.617519 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3af3702d-7abf-4a04-93ce-c8b41715db2e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.774073 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3af3702d-7abf-4a04-93ce-c8b41715db2e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:55.791693 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3af3702d-7abf-4a04-93ce-c8b41715db2e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1236 microversion: 2.1 time: 0.200542 Jul 25 05:59:55.793012 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 33/65] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:55 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1236 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:55.804291 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a8308a43-4a59-4cec-a10e-1273bbb8f365 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:55.805479 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a8308a43-4a59-4cec-a10e-1273bbb8f365 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:55.809379 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3a411c0d-0d2b-441f-9b3a-13337d08ad70 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:55.813802 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a8308a43-4a59-4cec-a10e-1273bbb8f365 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.817421 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a8308a43-4a59-4cec-a10e-1273bbb8f365 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.817421 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a8308a43-4a59-4cec-a10e-1273bbb8f365 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.817421 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a8308a43-4a59-4cec-a10e-1273bbb8f365 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.834223 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3a411c0d-0d2b-441f-9b3a-13337d08ad70 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.454849 Jul 25 05:59:55.834897 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 33/66] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:55 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:55.846716 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8a3cb395-2589-4334-80d0-645c351bbf35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:55.847332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8a3cb395-2589-4334-80d0-645c351bbf35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:55.863723 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a3cb395-2589-4334-80d0-645c351bbf35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.864221 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a3cb395-2589-4334-80d0-645c351bbf35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:55.872199 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a3cb395-2589-4334-80d0-645c351bbf35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:55.875951 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a3cb395-2589-4334-80d0-645c351bbf35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:56.069297 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a8308a43-4a59-4cec-a10e-1273bbb8f365 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:56.090054 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a8308a43-4a59-4cec-a10e-1273bbb8f365 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.294981 Jul 25 05:59:56.090954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 34/67] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:55 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:56.147451 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8a3cb395-2589-4334-80d0-645c351bbf35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:56.163540 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8a3cb395-2589-4334-80d0-645c351bbf35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:56.169129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8a3cb395-2589-4334-80d0-645c351bbf35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:56.170945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8a3cb395-2589-4334-80d0-645c351bbf35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1284 microversion: 2.20 time: 0.327860 Jul 25 05:59:56.184550 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 34/68] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:55 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1284 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:56.536688 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-575d7c6f-99fa-463d-bae8-041ab2178ba2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:56.537293 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-575d7c6f-99fa-463d-bae8-041ab2178ba2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:56.557262 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-575d7c6f-99fa-463d-bae8-041ab2178ba2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:56.557711 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-575d7c6f-99fa-463d-bae8-041ab2178ba2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:56.558499 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-575d7c6f-99fa-463d-bae8-041ab2178ba2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:56.559350 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-575d7c6f-99fa-463d-bae8-041ab2178ba2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:56.810563 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9c4b0b03-052c-4e17-8e70-51783513b967 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:56.811326 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9c4b0b03-052c-4e17-8e70-51783513b967 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:56.829374 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9c4b0b03-052c-4e17-8e70-51783513b967 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:56.829817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9c4b0b03-052c-4e17-8e70-51783513b967 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:56.830603 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9c4b0b03-052c-4e17-8e70-51783513b967 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:56.831034 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9c4b0b03-052c-4e17-8e70-51783513b967 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:57.113304 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9c4b0b03-052c-4e17-8e70-51783513b967 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:57.126433 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9c4b0b03-052c-4e17-8e70-51783513b967 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1292 microversion: 2.1 time: 0.316646 Jul 25 05:59:57.127094 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 35/69] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:56 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1292 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 05:59:57.157487 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-79ed138f-49c1-4a9e-8901-3b3b99c6959d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:57.161741 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-79ed138f-49c1-4a9e-8901-3b3b99c6959d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:57.171678 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:57.189581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-79ed138f-49c1-4a9e-8901-3b3b99c6959d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:57.192623 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-79ed138f-49c1-4a9e-8901-3b3b99c6959d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:57.194133 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-79ed138f-49c1-4a9e-8901-3b3b99c6959d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:57.198828 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-79ed138f-49c1-4a9e-8901-3b3b99c6959d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:57.493427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-575d7c6f-99fa-463d-bae8-041ab2178ba2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:57.501223 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-575d7c6f-99fa-463d-bae8-041ab2178ba2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.968405 Jul 25 05:59:57.501807 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 35/70] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:56 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:57.530469 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4b5eb726-5211-4cfa-b476-f1141af24848 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:57.531006 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4b5eb726-5211-4cfa-b476-f1141af24848 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:57.540609 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b5eb726-5211-4cfa-b476-f1141af24848 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:57.541989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b5eb726-5211-4cfa-b476-f1141af24848 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:57.542988 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b5eb726-5211-4cfa-b476-f1141af24848 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:57.576020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b5eb726-5211-4cfa-b476-f1141af24848 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:58.627862 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4b5eb726-5211-4cfa-b476-f1141af24848 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:58.652772 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4b5eb726-5211-4cfa-b476-f1141af24848 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 1.140742 Jul 25 05:59:58.653942 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 36/71] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:57 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:58.672176 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b809ae9f-6bc0-4104-8cbb-66ee35f01564 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:58.673934 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b809ae9f-6bc0-4104-8cbb-66ee35f01564 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:58.690372 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b809ae9f-6bc0-4104-8cbb-66ee35f01564 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:58.691052 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b809ae9f-6bc0-4104-8cbb-66ee35f01564 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:58.696447 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b809ae9f-6bc0-4104-8cbb-66ee35f01564 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:58.697814 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b809ae9f-6bc0-4104-8cbb-66ee35f01564 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:59.124583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b809ae9f-6bc0-4104-8cbb-66ee35f01564 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:59.135467 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b809ae9f-6bc0-4104-8cbb-66ee35f01564 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:59.137042 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b809ae9f-6bc0-4104-8cbb-66ee35f01564 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:59.160747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b809ae9f-6bc0-4104-8cbb-66ee35f01564 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1338 microversion: 2.20 time: 0.503894 Jul 25 05:59:59.161677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 05:59:58 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1338 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 05:59:59.176073 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-af44ec4b-a0c6-4e43-b35a-d5589052324d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:59.177190 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-af44ec4b-a0c6-4e43-b35a-d5589052324d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:59.191739 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af44ec4b-a0c6-4e43-b35a-d5589052324d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:59.192795 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af44ec4b-a0c6-4e43-b35a-d5589052324d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:59.193749 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af44ec4b-a0c6-4e43-b35a-d5589052324d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:59.197228 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af44ec4b-a0c6-4e43-b35a-d5589052324d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:59.349641 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-79ed138f-49c1-4a9e-8901-3b3b99c6959d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:59.366913 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-79ed138f-49c1-4a9e-8901-3b3b99c6959d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 2.223713 Jul 25 05:59:59.368948 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 36/73] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:57 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 2241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:59.377969 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2f4853e1-8a8d-40c6-af4b-7ea534171a8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:59.378891 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2f4853e1-8a8d-40c6-af4b-7ea534171a8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:59.400873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2f4853e1-8a8d-40c6-af4b-7ea534171a8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:59.403400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2f4853e1-8a8d-40c6-af4b-7ea534171a8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:59.404884 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2f4853e1-8a8d-40c6-af4b-7ea534171a8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:59.405467 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2f4853e1-8a8d-40c6-af4b-7ea534171a8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:59.728226 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=8 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:59:59.767390 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-af44ec4b-a0c6-4e43-b35a-d5589052324d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 05:59:59.778123 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-af44ec4b-a0c6-4e43-b35a-d5589052324d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1298 microversion: 2.1 time: 0.615022 Jul 25 05:59:59.783288 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 38/74] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:59 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1298 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 05:59:59.793639 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e1610393-394e-4b08-98ce-e65f0967fc93 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 05:59:59.795695 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e1610393-394e-4b08-98ce-e65f0967fc93 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 05:59:59.813705 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e1610393-394e-4b08-98ce-e65f0967fc93 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:59.814565 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e1610393-394e-4b08-98ce-e65f0967fc93 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 05:59:59.814942 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e1610393-394e-4b08-98ce-e65f0967fc93 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 05:59:59.815384 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e1610393-394e-4b08-98ce-e65f0967fc93 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:00.163568 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2f4853e1-8a8d-40c6-af4b-7ea534171a8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:00.176604 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2f4853e1-8a8d-40c6-af4b-7ea534171a8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.806064 Jul 25 06:00:00.190231 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 37/75] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:59 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:00.204435 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-e1610393-394e-4b08-98ce-e65f0967fc93 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:00.213384 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1cff0a18-240b-46ed-8dd0-fdbaba847b9b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:00.214669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1cff0a18-240b-46ed-8dd0-fdbaba847b9b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:00.217334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e1610393-394e-4b08-98ce-e65f0967fc93 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.432688 Jul 25 06:00:00.220203 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 39/76] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 05:59:59 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:00.278615 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1cff0a18-240b-46ed-8dd0-fdbaba847b9b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:00.280138 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1cff0a18-240b-46ed-8dd0-fdbaba847b9b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:00.281829 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1cff0a18-240b-46ed-8dd0-fdbaba847b9b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:00.283140 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1cff0a18-240b-46ed-8dd0-fdbaba847b9b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:00.313899 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:00.387172 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c44af8f4-d0ff-4280-942d-f1211a73d330 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:00.387703 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c44af8f4-d0ff-4280-942d-f1211a73d330 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:00.408941 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c44af8f4-d0ff-4280-942d-f1211a73d330 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:00.410642 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c44af8f4-d0ff-4280-942d-f1211a73d330 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:00.410642 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c44af8f4-d0ff-4280-942d-f1211a73d330 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:00.410642 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c44af8f4-d0ff-4280-942d-f1211a73d330 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:00.541037 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1cff0a18-240b-46ed-8dd0-fdbaba847b9b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:00.550042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1cff0a18-240b-46ed-8dd0-fdbaba847b9b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:00.559083 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1cff0a18-240b-46ed-8dd0-fdbaba847b9b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:00.560559 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1cff0a18-240b-46ed-8dd0-fdbaba847b9b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1338 microversion: 2.20 time: 0.368718 Jul 25 06:00:00.572901 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 38/77] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:00 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1338 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:00.690668 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=4 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:00.802968 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c7674bbe-c72d-4af8-b5a8-ed97eaf967ba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:00.803962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c7674bbe-c72d-4af8-b5a8-ed97eaf967ba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:00.816835 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c7674bbe-c72d-4af8-b5a8-ed97eaf967ba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:00.832709 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c7674bbe-c72d-4af8-b5a8-ed97eaf967ba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:00.836338 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c7674bbe-c72d-4af8-b5a8-ed97eaf967ba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:00.837847 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c7674bbe-c72d-4af8-b5a8-ed97eaf967ba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:01.257415 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c7674bbe-c72d-4af8-b5a8-ed97eaf967ba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:01.267027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c7674bbe-c72d-4af8-b5a8-ed97eaf967ba tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1298 microversion: 2.1 time: 0.468089 Jul 25 06:00:01.274125 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 39/78] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:00 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1298 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:01.299382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4bc0a05d-9fef-4fdd-bac0-cd387157681c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:01.301622 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4bc0a05d-9fef-4fdd-bac0-cd387157681c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:01.313743 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4bc0a05d-9fef-4fdd-bac0-cd387157681c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:01.322393 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4bc0a05d-9fef-4fdd-bac0-cd387157681c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:01.331206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4bc0a05d-9fef-4fdd-bac0-cd387157681c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:01.339365 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4bc0a05d-9fef-4fdd-bac0-cd387157681c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:01.470929 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=40 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:01.681533 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c44af8f4-d0ff-4280-942d-f1211a73d330 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:01.691608 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c44af8f4-d0ff-4280-942d-f1211a73d330 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 1.310825 Jul 25 06:00:01.698362 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 40/79] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:00 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:01.703569 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-08b770b8-9ad1-45cc-a469-e66f8a6e3bea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:01.714068 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-08b770b8-9ad1-45cc-a469-e66f8a6e3bea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:01.738121 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-08b770b8-9ad1-45cc-a469-e66f8a6e3bea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:01.738837 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-08b770b8-9ad1-45cc-a469-e66f8a6e3bea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:01.739820 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-08b770b8-9ad1-45cc-a469-e66f8a6e3bea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:01.746021 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-08b770b8-9ad1-45cc-a469-e66f8a6e3bea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:02.201781 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=26 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:02.210175 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4bc0a05d-9fef-4fdd-bac0-cd387157681c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:02.229730 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4bc0a05d-9fef-4fdd-bac0-cd387157681c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.950041 Jul 25 06:00:02.230492 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 40/80] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:01 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:02.518031 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-813cda0d-8035-4c47-8848-8852a3e78627 req-6fee5327-6b0d-4e50-9e56-544fb645f3b6 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "a502c8d3-07ac-4e7f-9127-1281c94c5724", "tag": "a7211a3e-e5a1-4df6-b97c-4d903ce963ca"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:02.550765 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-813cda0d-8035-4c47-8848-8852a3e78627 req-6fee5327-6b0d-4e50-9e56-544fb645f3b6 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:02.551193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-813cda0d-8035-4c47-8848-8852a3e78627 req-6fee5327-6b0d-4e50-9e56-544fb645f3b6 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:02.595367 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-813cda0d-8035-4c47-8848-8852a3e78627 req-6fee5327-6b0d-4e50-9e56-544fb645f3b6 service nova] Creating event network-changed:a7211a3e-e5a1-4df6-b97c-4d903ce963ca for instance a502c8d3-07ac-4e7f-9127-1281c94c5724 on hv-cinder-84841 Jul 25 06:00:02.595900 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-813cda0d-8035-4c47-8848-8852a3e78627 req-6fee5327-6b0d-4e50-9e56-544fb645f3b6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124917) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 06:00:02.605954 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59b01038-d4a4-4896-9492-b1a541cff4d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:02.616658 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59b01038-d4a4-4896-9492-b1a541cff4d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:02.619805 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59b01038-d4a4-4896-9492-b1a541cff4d8 None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:02.620428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59b01038-d4a4-4896-9492-b1a541cff4d8 None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:02.643943 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.compute.rpcapi [None req-59b01038-d4a4-4896-9492-b1a541cff4d8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 06:00:02.645311 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59b01038-d4a4-4896-9492-b1a541cff4d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=124917) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 06:00:02.668083 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-59b01038-d4a4-4896-9492-b1a541cff4d8 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.434433 Jul 25 06:00:02.682134 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 41/81] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:02.701743 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f9b3395b-03fd-4f14-9997-04b3619f7b20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:02.704769 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f9b3395b-03fd-4f14-9997-04b3619f7b20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:02.719909 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f9b3395b-03fd-4f14-9997-04b3619f7b20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:02.720626 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f9b3395b-03fd-4f14-9997-04b3619f7b20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:02.721719 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f9b3395b-03fd-4f14-9997-04b3619f7b20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:02.722598 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f9b3395b-03fd-4f14-9997-04b3619f7b20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:02.816737 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-08b770b8-9ad1-45cc-a469-e66f8a6e3bea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:02.831322 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=100 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:02.843903 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-08b770b8-9ad1-45cc-a469-e66f8a6e3bea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 1.143601 Jul 25 06:00:02.857877 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 41/82] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:01 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:02.879827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6ebae375-9da1-46fb-bc01-898a0233487f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:02.881932 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6ebae375-9da1-46fb-bc01-898a0233487f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:02.887295 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f9b3395b-03fd-4f14-9997-04b3619f7b20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:02.891897 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6ebae375-9da1-46fb-bc01-898a0233487f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:02.892714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6ebae375-9da1-46fb-bc01-898a0233487f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:02.893736 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6ebae375-9da1-46fb-bc01-898a0233487f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:02.894320 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6ebae375-9da1-46fb-bc01-898a0233487f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:02.908147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f9b3395b-03fd-4f14-9997-04b3619f7b20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:02.916021 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f9b3395b-03fd-4f14-9997-04b3619f7b20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:02.920316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f9b3395b-03fd-4f14-9997-04b3619f7b20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1338 microversion: 2.20 time: 0.231461 Jul 25 06:00:02.937711 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 42/83] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:02 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1338 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:03.078516 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-836110d5-3159-4109-9702-748f1e4d2eae req-68208499-5fa9-4aa5-a956-2a7709135bba service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "ccf69bbe-b5ad-4061-9250-f2f3f0edee2d", "tag": "de159745-94e2-418c-9c37-533af5667e21"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:03.105981 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-836110d5-3159-4109-9702-748f1e4d2eae req-68208499-5fa9-4aa5-a956-2a7709135bba service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:03.105981 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-836110d5-3159-4109-9702-748f1e4d2eae req-68208499-5fa9-4aa5-a956-2a7709135bba service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:03.136941 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-836110d5-3159-4109-9702-748f1e4d2eae req-68208499-5fa9-4aa5-a956-2a7709135bba service nova] Creating event network-changed:de159745-94e2-418c-9c37-533af5667e21 for instance ccf69bbe-b5ad-4061-9250-f2f3f0edee2d on hv-cinder-84841 Jul 25 06:00:03.151010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-836110d5-3159-4109-9702-748f1e4d2eae req-68208499-5fa9-4aa5-a956-2a7709135bba service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209242 Jul 25 06:00:03.151464 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 43/84] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:03.159221 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-761a4b0b-c231-4046-997a-575ec4520e3e tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:03.160268 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-761a4b0b-c231-4046-997a-575ec4520e3e tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:03.171166 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-761a4b0b-c231-4046-997a-575ec4520e3e tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:03.171899 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-761a4b0b-c231-4046-997a-575ec4520e3e tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:03.172796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-761a4b0b-c231-4046-997a-575ec4520e3e tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:03.173498 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-761a4b0b-c231-4046-997a-575ec4520e3e tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:03.697490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-761a4b0b-c231-4046-997a-575ec4520e3e tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:03.706506 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-761a4b0b-c231-4046-997a-575ec4520e3e tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.553352 Jul 25 06:00:03.707669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 44/85] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:03 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:03.729902 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-25f950b2-7915-45db-9877-44da1ec6f208 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:03.730966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-25f950b2-7915-45db-9877-44da1ec6f208 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:03.740968 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-25f950b2-7915-45db-9877-44da1ec6f208 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:03.747890 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-25f950b2-7915-45db-9877-44da1ec6f208 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:03.749270 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-25f950b2-7915-45db-9877-44da1ec6f208 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:03.750950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-25f950b2-7915-45db-9877-44da1ec6f208 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:03.936322 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6ebae375-9da1-46fb-bc01-898a0233487f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:03.953703 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6ebae375-9da1-46fb-bc01-898a0233487f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 1.090629 Jul 25 06:00:03.953703 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 42/86] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:02 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:03.960850 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-60a1f850-c9f5-49a9-8a9d-e74f88ebd2cf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:03.961740 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-60a1f850-c9f5-49a9-8a9d-e74f88ebd2cf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:03.969684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-60a1f850-c9f5-49a9-8a9d-e74f88ebd2cf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:03.970132 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-60a1f850-c9f5-49a9-8a9d-e74f88ebd2cf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:03.970911 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-60a1f850-c9f5-49a9-8a9d-e74f88ebd2cf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:03.971479 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-60a1f850-c9f5-49a9-8a9d-e74f88ebd2cf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:04.448797 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-60a1f850-c9f5-49a9-8a9d-e74f88ebd2cf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:04.462735 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-60a1f850-c9f5-49a9-8a9d-e74f88ebd2cf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.510859 Jul 25 06:00:04.472971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 43/87] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:03 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:04.478814 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-faae0a5e-4793-4baf-8ef5-1914d8286608 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:04.479726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-faae0a5e-4793-4baf-8ef5-1914d8286608 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:04.494676 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-faae0a5e-4793-4baf-8ef5-1914d8286608 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:04.495406 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-faae0a5e-4793-4baf-8ef5-1914d8286608 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:04.496417 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-faae0a5e-4793-4baf-8ef5-1914d8286608 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:04.497053 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-faae0a5e-4793-4baf-8ef5-1914d8286608 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:04.544412 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-25f950b2-7915-45db-9877-44da1ec6f208 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:04.556560 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-25f950b2-7915-45db-9877-44da1ec6f208 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.844412 Jul 25 06:00:04.556560 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 45/88] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:03 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:04.725806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-faae0a5e-4793-4baf-8ef5-1914d8286608 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:04.725944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-30d2009e-b6cc-4a2a-93c5-d130aaf4700c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:04.726479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-30d2009e-b6cc-4a2a-93c5-d130aaf4700c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:04.734979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-faae0a5e-4793-4baf-8ef5-1914d8286608 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:04.736836 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-faae0a5e-4793-4baf-8ef5-1914d8286608 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:04.738423 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-faae0a5e-4793-4baf-8ef5-1914d8286608 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.264164 Jul 25 06:00:04.740346 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-30d2009e-b6cc-4a2a-93c5-d130aaf4700c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:04.741696 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-30d2009e-b6cc-4a2a-93c5-d130aaf4700c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:04.743348 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-30d2009e-b6cc-4a2a-93c5-d130aaf4700c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:04.745007 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-30d2009e-b6cc-4a2a-93c5-d130aaf4700c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:04.750543 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 44/89] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:04 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:04.754985 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-b9427aaa-f70a-4e02-870d-ee14789a37e3 req-d79e9f5d-fd23-4b1d-9d22-7cb9688e24ee service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf", "tag": "07e8aaba-4e29-4898-865b-3e4e9f738a49"}, {"name": "network-changed", "server_uuid": "eb9a76df-da50-4f8c-8d6d-c3be003f0a25", "tag": "d356fd90-eba7-42c0-b027-05d5c7ddce5d"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:04.768491 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-b9427aaa-f70a-4e02-870d-ee14789a37e3 req-d79e9f5d-fd23-4b1d-9d22-7cb9688e24ee service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:04.769156 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-b9427aaa-f70a-4e02-870d-ee14789a37e3 req-d79e9f5d-fd23-4b1d-9d22-7cb9688e24ee service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:04.791813 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-b9427aaa-f70a-4e02-870d-ee14789a37e3 req-d79e9f5d-fd23-4b1d-9d22-7cb9688e24ee service nova] Creating event network-changed:07e8aaba-4e29-4898-865b-3e4e9f738a49 for instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf on hv-cinder-84841 Jul 25 06:00:04.792349 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-b9427aaa-f70a-4e02-870d-ee14789a37e3 req-d79e9f5d-fd23-4b1d-9d22-7cb9688e24ee service nova] Creating event network-changed:d356fd90-eba7-42c0-b027-05d5c7ddce5d for instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 on hv-cinder-84841 Jul 25 06:00:04.793112 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-b9427aaa-f70a-4e02-870d-ee14789a37e3 req-d79e9f5d-fd23-4b1d-9d22-7cb9688e24ee service nova] Acquired lock "compute-rpcapi-router" {{(pid=124918) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 06:00:04.794202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5bc54114-2820-40d7-929d-e22d174a7697 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:04.794798 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5bc54114-2820-40d7-929d-e22d174a7697 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:04.795566 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5bc54114-2820-40d7-929d-e22d174a7697 None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:04.795986 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5bc54114-2820-40d7-929d-e22d174a7697 None None] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:04.804968 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.compute.rpcapi [None req-5bc54114-2820-40d7-929d-e22d174a7697 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 06:00:04.806119 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5bc54114-2820-40d7-929d-e22d174a7697 None None] Releasing lock "compute-rpcapi-router" {{(pid=124918) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 06:00:04.826150 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5bc54114-2820-40d7-929d-e22d174a7697 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.074624 Jul 25 06:00:04.827310 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 45/90] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:04.900698 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-30d2009e-b6cc-4a2a-93c5-d130aaf4700c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:04.909868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-30d2009e-b6cc-4a2a-93c5-d130aaf4700c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.189068 Jul 25 06:00:04.910873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 46/91] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:04 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:04.969585 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-422beb41-7f7a-4406-9e86-c59482caf63d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:04.970300 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-422beb41-7f7a-4406-9e86-c59482caf63d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:04.982909 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-422beb41-7f7a-4406-9e86-c59482caf63d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:04.983475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-422beb41-7f7a-4406-9e86-c59482caf63d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:04.984304 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-422beb41-7f7a-4406-9e86-c59482caf63d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:04.984746 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-422beb41-7f7a-4406-9e86-c59482caf63d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:05.147478 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-422beb41-7f7a-4406-9e86-c59482caf63d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:05.157014 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-422beb41-7f7a-4406-9e86-c59482caf63d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.191756 Jul 25 06:00:05.157667 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 46/92] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:04 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:05.334598 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-592000a6-9195-4916-b580-bfc9f93baacc req-d3b5ed61-44ea-4fe8-870a-7a11c5eb89f5 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "efb335ec-f540-494a-a2c7-c8db2f467c02", "tag": "d39effe6-1cf3-4165-9474-bb2a0cbbe15d"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:05.346177 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-592000a6-9195-4916-b580-bfc9f93baacc req-d3b5ed61-44ea-4fe8-870a-7a11c5eb89f5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:05.346554 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-592000a6-9195-4916-b580-bfc9f93baacc req-d3b5ed61-44ea-4fe8-870a-7a11c5eb89f5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:05.359871 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-592000a6-9195-4916-b580-bfc9f93baacc req-d3b5ed61-44ea-4fe8-870a-7a11c5eb89f5 service nova] Creating event network-changed:d39effe6-1cf3-4165-9474-bb2a0cbbe15d for instance efb335ec-f540-494a-a2c7-c8db2f467c02 on hv-cinder-84841 Jul 25 06:00:05.365129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-592000a6-9195-4916-b580-bfc9f93baacc req-d3b5ed61-44ea-4fe8-870a-7a11c5eb89f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034295 Jul 25 06:00:05.365955 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 47/93] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:05.490482 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8184fe2c-3d4f-434d-844d-ec6b579320fc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:05.491079 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-8184fe2c-3d4f-434d-844d-ec6b579320fc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:05.497648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8184fe2c-3d4f-434d-844d-ec6b579320fc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:05.498092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8184fe2c-3d4f-434d-844d-ec6b579320fc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:05.498952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8184fe2c-3d4f-434d-844d-ec6b579320fc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:05.499311 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8184fe2c-3d4f-434d-844d-ec6b579320fc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:05.572581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-95369e47-471b-4cc0-8a2d-3dac25876a57 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:05.573462 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-95369e47-471b-4cc0-8a2d-3dac25876a57 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:05.580602 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95369e47-471b-4cc0-8a2d-3dac25876a57 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:05.581263 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95369e47-471b-4cc0-8a2d-3dac25876a57 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:05.582042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95369e47-471b-4cc0-8a2d-3dac25876a57 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:05.582480 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95369e47-471b-4cc0-8a2d-3dac25876a57 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:05.718264 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8184fe2c-3d4f-434d-844d-ec6b579320fc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:05.728032 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8184fe2c-3d4f-434d-844d-ec6b579320fc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.241040 Jul 25 06:00:05.729548 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 47/94] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:05 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:05.760195 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9d5c28cf-6454-44a9-a35f-6012234639ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:05.760805 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9d5c28cf-6454-44a9-a35f-6012234639ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:05.762968 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-95369e47-471b-4cc0-8a2d-3dac25876a57 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:05.771447 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9d5c28cf-6454-44a9-a35f-6012234639ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:05.771910 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9d5c28cf-6454-44a9-a35f-6012234639ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:05.772750 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9d5c28cf-6454-44a9-a35f-6012234639ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:05.773185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9d5c28cf-6454-44a9-a35f-6012234639ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:05.773793 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-95369e47-471b-4cc0-8a2d-3dac25876a57 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.206537 Jul 25 06:00:05.775630 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 48/95] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:05 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:05.929999 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-24e93e24-4ed6-4b43-ab93-73e2885a12b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:05.930849 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-24e93e24-4ed6-4b43-ab93-73e2885a12b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:05.934138 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9d5c28cf-6454-44a9-a35f-6012234639ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:05.937312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-24e93e24-4ed6-4b43-ab93-73e2885a12b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:05.937936 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-24e93e24-4ed6-4b43-ab93-73e2885a12b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:05.938907 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-24e93e24-4ed6-4b43-ab93-73e2885a12b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:05.940228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-24e93e24-4ed6-4b43-ab93-73e2885a12b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:05.959606 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9d5c28cf-6454-44a9-a35f-6012234639ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:05.964435 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9d5c28cf-6454-44a9-a35f-6012234639ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:05.966821 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9d5c28cf-6454-44a9-a35f-6012234639ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.212533 Jul 25 06:00:05.980028 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 48/96] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:05 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:06.109319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-24e93e24-4ed6-4b43-ab93-73e2885a12b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:06.117130 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-24e93e24-4ed6-4b43-ab93-73e2885a12b1 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.191398 Jul 25 06:00:06.118603 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 49/97] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:05 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:06.174664 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4d57d146-12a7-4713-b9e7-98ec1b71f202 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:06.175379 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4d57d146-12a7-4713-b9e7-98ec1b71f202 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:06.181885 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4d57d146-12a7-4713-b9e7-98ec1b71f202 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:06.182334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4d57d146-12a7-4713-b9e7-98ec1b71f202 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:06.183089 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4d57d146-12a7-4713-b9e7-98ec1b71f202 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:06.183524 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4d57d146-12a7-4713-b9e7-98ec1b71f202 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:06.322849 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4d57d146-12a7-4713-b9e7-98ec1b71f202 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:06.330475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4d57d146-12a7-4713-b9e7-98ec1b71f202 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.159871 Jul 25 06:00:06.331176 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 49/98] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:06 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:06.747773 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ae1cb367-624b-4ace-bbd6-72c0f746c8c1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:06.749870 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ae1cb367-624b-4ace-bbd6-72c0f746c8c1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:06.781532 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ae1cb367-624b-4ace-bbd6-72c0f746c8c1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:06.782173 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ae1cb367-624b-4ace-bbd6-72c0f746c8c1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:06.783027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ae1cb367-624b-4ace-bbd6-72c0f746c8c1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:06.783526 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ae1cb367-624b-4ace-bbd6-72c0f746c8c1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:06.792098 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-22b9e4d1-6800-4523-82c3-609304bc5619 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:06.793028 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-22b9e4d1-6800-4523-82c3-609304bc5619 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:06.800524 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-22b9e4d1-6800-4523-82c3-609304bc5619 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:06.802064 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-22b9e4d1-6800-4523-82c3-609304bc5619 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:06.807051 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-22b9e4d1-6800-4523-82c3-609304bc5619 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:06.807692 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-22b9e4d1-6800-4523-82c3-609304bc5619 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:07.013782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ae1cb367-624b-4ace-bbd6-72c0f746c8c1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:07.025258 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ae1cb367-624b-4ace-bbd6-72c0f746c8c1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.282564 Jul 25 06:00:07.028011 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 50/99] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:06 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:07.033491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f3e3ab1e-6370-467e-9853-430e4b9c922d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:07.034105 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f3e3ab1e-6370-467e-9853-430e4b9c922d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:07.054319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f3e3ab1e-6370-467e-9853-430e4b9c922d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:07.054319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f3e3ab1e-6370-467e-9853-430e4b9c922d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:07.054319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f3e3ab1e-6370-467e-9853-430e4b9c922d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:07.054641 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f3e3ab1e-6370-467e-9853-430e4b9c922d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:07.105373 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-22b9e4d1-6800-4523-82c3-609304bc5619 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:07.114444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-22b9e4d1-6800-4523-82c3-609304bc5619 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.325839 Jul 25 06:00:07.142350 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 50/100] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:06 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:07.153143 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-686e7e6d-fe69-4555-b1c8-db00ae13fa43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:07.155639 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-686e7e6d-fe69-4555-b1c8-db00ae13fa43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:07.175468 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-686e7e6d-fe69-4555-b1c8-db00ae13fa43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:07.176310 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-686e7e6d-fe69-4555-b1c8-db00ae13fa43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:07.178589 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-686e7e6d-fe69-4555-b1c8-db00ae13fa43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:07.181788 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-686e7e6d-fe69-4555-b1c8-db00ae13fa43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:07.240915 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f3e3ab1e-6370-467e-9853-430e4b9c922d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:07.252548 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f3e3ab1e-6370-467e-9853-430e4b9c922d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:07.254486 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f3e3ab1e-6370-467e-9853-430e4b9c922d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:07.256065 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f3e3ab1e-6370-467e-9853-430e4b9c922d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.226793 Jul 25 06:00:07.257255 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 51/101] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:07 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:07.348947 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-cd636b6a-fdf3-48e4-8d4f-bf9e46e36372 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:07.349861 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cd636b6a-fdf3-48e4-8d4f-bf9e46e36372 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:07.359800 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cd636b6a-fdf3-48e4-8d4f-bf9e46e36372 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:07.365649 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cd636b6a-fdf3-48e4-8d4f-bf9e46e36372 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:07.366741 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cd636b6a-fdf3-48e4-8d4f-bf9e46e36372 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:07.371129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cd636b6a-fdf3-48e4-8d4f-bf9e46e36372 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:07.401889 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-686e7e6d-fe69-4555-b1c8-db00ae13fa43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:07.410054 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-686e7e6d-fe69-4555-b1c8-db00ae13fa43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.266225 Jul 25 06:00:07.413266 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 51/102] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:07 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:07.601815 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-cd636b6a-fdf3-48e4-8d4f-bf9e46e36372 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:07.614135 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-cd636b6a-fdf3-48e4-8d4f-bf9e46e36372 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.269087 Jul 25 06:00:07.616061 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 52/103] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:07 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:08.194709 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c560ca9f-124d-4c2a-8305-5abb60887a38 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:08.194709 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c560ca9f-124d-4c2a-8305-5abb60887a38 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:08.194709 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c560ca9f-124d-4c2a-8305-5abb60887a38 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.194709 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c560ca9f-124d-4c2a-8305-5abb60887a38 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.199341 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c560ca9f-124d-4c2a-8305-5abb60887a38 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.199341 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c560ca9f-124d-4c2a-8305-5abb60887a38 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.199825 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-96a3c587-5ff8-421d-852b-8eaec6aaf253 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:08.199825 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-96a3c587-5ff8-421d-852b-8eaec6aaf253 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:08.199825 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-96a3c587-5ff8-421d-852b-8eaec6aaf253 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.199825 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-96a3c587-5ff8-421d-852b-8eaec6aaf253 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.200617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-96a3c587-5ff8-421d-852b-8eaec6aaf253 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.200617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-96a3c587-5ff8-421d-852b-8eaec6aaf253 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.200941 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c560ca9f-124d-4c2a-8305-5abb60887a38 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:08.200941 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c560ca9f-124d-4c2a-8305-5abb60887a38 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.151778 Jul 25 06:00:08.200941 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 52/104] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:08 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:08.277012 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-efffbcc7-a3c0-4783-97fe-164228d25e2a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:08.278012 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-efffbcc7-a3c0-4783-97fe-164228d25e2a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:08.284237 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-a3c0-4783-97fe-164228d25e2a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.284854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-a3c0-4783-97fe-164228d25e2a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.285637 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-a3c0-4783-97fe-164228d25e2a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.286811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-efffbcc7-a3c0-4783-97fe-164228d25e2a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.312911 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-96a3c587-5ff8-421d-852b-8eaec6aaf253 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:08.321954 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-96a3c587-5ff8-421d-852b-8eaec6aaf253 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.193873 Jul 25 06:00:08.332271 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 53/105] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:08 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:08.428565 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-20b61afa-372e-4e35-94e3-06380b58218b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:08.429436 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-20b61afa-372e-4e35-94e3-06380b58218b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:08.436624 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-20b61afa-372e-4e35-94e3-06380b58218b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.437446 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-20b61afa-372e-4e35-94e3-06380b58218b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.438386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-20b61afa-372e-4e35-94e3-06380b58218b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.438981 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-20b61afa-372e-4e35-94e3-06380b58218b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.439813 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-efffbcc7-a3c0-4783-97fe-164228d25e2a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:08.450487 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-efffbcc7-a3c0-4783-97fe-164228d25e2a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:08.452941 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-efffbcc7-a3c0-4783-97fe-164228d25e2a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:08.454278 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-efffbcc7-a3c0-4783-97fe-164228d25e2a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.183391 Jul 25 06:00:08.455532 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 53/106] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:08 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:08.673447 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-20b61afa-372e-4e35-94e3-06380b58218b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:08.673447 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-20b61afa-372e-4e35-94e3-06380b58218b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.164548 Jul 25 06:00:08.673447 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 54/107] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:08 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:08.674286 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4f64fc41-3626-4555-a628-433d4faaf556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:08.674286 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4f64fc41-3626-4555-a628-433d4faaf556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:08.674286 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f64fc41-3626-4555-a628-433d4faaf556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.674286 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f64fc41-3626-4555-a628-433d4faaf556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.674684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f64fc41-3626-4555-a628-433d4faaf556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:08.674684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f64fc41-3626-4555-a628-433d4faaf556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:08.775821 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4f64fc41-3626-4555-a628-433d4faaf556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:08.783613 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4f64fc41-3626-4555-a628-433d4faaf556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.154025 Jul 25 06:00:08.784267 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 54/108] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:08 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:09.207634 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-73879a29-7302-47c1-8986-2108ad4784b8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:09.208277 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-73879a29-7302-47c1-8986-2108ad4784b8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:09.215303 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-73879a29-7302-47c1-8986-2108ad4784b8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.215762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-73879a29-7302-47c1-8986-2108ad4784b8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.216564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-73879a29-7302-47c1-8986-2108ad4784b8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.217001 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-73879a29-7302-47c1-8986-2108ad4784b8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.339391 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b4306acc-8895-4ca2-9e72-85cf44bb25e7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:09.345479 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b4306acc-8895-4ca2-9e72-85cf44bb25e7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:09.347055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b4306acc-8895-4ca2-9e72-85cf44bb25e7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.347494 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b4306acc-8895-4ca2-9e72-85cf44bb25e7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.348457 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b4306acc-8895-4ca2-9e72-85cf44bb25e7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.349103 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b4306acc-8895-4ca2-9e72-85cf44bb25e7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.355708 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-73879a29-7302-47c1-8986-2108ad4784b8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:09.365266 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-73879a29-7302-47c1-8986-2108ad4784b8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.161448 Jul 25 06:00:09.366539 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 55/109] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:09 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:09.473745 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-819b2419-8bf8-405b-8253-83989f0b8bd4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:09.476102 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-819b2419-8bf8-405b-8253-83989f0b8bd4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:09.483720 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-819b2419-8bf8-405b-8253-83989f0b8bd4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.484335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-819b2419-8bf8-405b-8253-83989f0b8bd4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.485311 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-819b2419-8bf8-405b-8253-83989f0b8bd4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.485809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-819b2419-8bf8-405b-8253-83989f0b8bd4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.500333 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b4306acc-8895-4ca2-9e72-85cf44bb25e7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:09.513834 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b4306acc-8895-4ca2-9e72-85cf44bb25e7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.178765 Jul 25 06:00:09.514544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 55/110] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:09 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:09.516490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:09.630602 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-819b2419-8bf8-405b-8253-83989f0b8bd4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:09.639138 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-819b2419-8bf8-405b-8253-83989f0b8bd4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:09.640693 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-819b2419-8bf8-405b-8253-83989f0b8bd4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:09.641849 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-819b2419-8bf8-405b-8253-83989f0b8bd4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.173066 Jul 25 06:00:09.642437 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 56/111] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:09 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:00:09.677979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a71003c9-da7f-4a32-9fa6-6ec7c6400e55 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:09.678625 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a71003c9-da7f-4a32-9fa6-6ec7c6400e55 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:09.685045 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a71003c9-da7f-4a32-9fa6-6ec7c6400e55 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.685469 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a71003c9-da7f-4a32-9fa6-6ec7c6400e55 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.686229 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a71003c9-da7f-4a32-9fa6-6ec7c6400e55 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.686661 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a71003c9-da7f-4a32-9fa6-6ec7c6400e55 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.801371 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-37c8a52a-7005-4ae9-946b-d0ebb6638fe9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:09.802065 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-37c8a52a-7005-4ae9-946b-d0ebb6638fe9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:09.809735 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-37c8a52a-7005-4ae9-946b-d0ebb6638fe9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.810280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-37c8a52a-7005-4ae9-946b-d0ebb6638fe9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.811107 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-37c8a52a-7005-4ae9-946b-d0ebb6638fe9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:09.811603 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-37c8a52a-7005-4ae9-946b-d0ebb6638fe9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:09.938300 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a71003c9-da7f-4a32-9fa6-6ec7c6400e55 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:09.948693 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a71003c9-da7f-4a32-9fa6-6ec7c6400e55 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.274410 Jul 25 06:00:09.949513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 56/112] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:09 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:10.032720 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-37c8a52a-7005-4ae9-946b-d0ebb6638fe9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:10.042562 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-37c8a52a-7005-4ae9-946b-d0ebb6638fe9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.245582 Jul 25 06:00:10.043147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 57/113] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:09 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:10.383472 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6476ed46-0f79-4a38-9521-b61419ebd96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:10.384243 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6476ed46-0f79-4a38-9521-b61419ebd96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:10.391114 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6476ed46-0f79-4a38-9521-b61419ebd96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:10.395372 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6476ed46-0f79-4a38-9521-b61419ebd96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:10.395372 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6476ed46-0f79-4a38-9521-b61419ebd96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:10.395372 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6476ed46-0f79-4a38-9521-b61419ebd96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:10.534723 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0fbd144b-5577-4304-8c67-76ea350d62ac tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:10.538895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0fbd144b-5577-4304-8c67-76ea350d62ac tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:10.545827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0fbd144b-5577-4304-8c67-76ea350d62ac tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:10.546371 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0fbd144b-5577-4304-8c67-76ea350d62ac tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:10.547570 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0fbd144b-5577-4304-8c67-76ea350d62ac tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:10.548067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0fbd144b-5577-4304-8c67-76ea350d62ac tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:10.722382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0fbd144b-5577-4304-8c67-76ea350d62ac tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:10.730729 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0fbd144b-5577-4304-8c67-76ea350d62ac tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.202792 Jul 25 06:00:10.736228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 58/114] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:10 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:10.743536 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2dda0eb7-24a2-4d56-a4fb-31d3902c4d05 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:10.761461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2dda0eb7-24a2-4d56-a4fb-31d3902c4d05 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:10.761827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6476ed46-0f79-4a38-9521-b61419ebd96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:10.761929 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2dda0eb7-24a2-4d56-a4fb-31d3902c4d05 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:10.761929 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2dda0eb7-24a2-4d56-a4fb-31d3902c4d05 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:10.761929 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2dda0eb7-24a2-4d56-a4fb-31d3902c4d05 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:10.761929 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2dda0eb7-24a2-4d56-a4fb-31d3902c4d05 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:10.762210 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6476ed46-0f79-4a38-9521-b61419ebd96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.378032 Jul 25 06:00:10.762210 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 57/115] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:10 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:10.912482 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2dda0eb7-24a2-4d56-a4fb-31d3902c4d05 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:10.929803 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2dda0eb7-24a2-4d56-a4fb-31d3902c4d05 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:10.929803 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2dda0eb7-24a2-4d56-a4fb-31d3902c4d05 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:10.929803 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2dda0eb7-24a2-4d56-a4fb-31d3902c4d05 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.191172 Jul 25 06:00:10.930658 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 59/116] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:10 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:10.969294 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2860fdcc-323b-4cfb-9910-81fc71622563 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:10.970113 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2860fdcc-323b-4cfb-9910-81fc71622563 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:10.978611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2860fdcc-323b-4cfb-9910-81fc71622563 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:10.979333 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2860fdcc-323b-4cfb-9910-81fc71622563 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:10.980606 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2860fdcc-323b-4cfb-9910-81fc71622563 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:10.981510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2860fdcc-323b-4cfb-9910-81fc71622563 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:11.061294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f836df75-4fb9-4164-9a15-c372141b0099 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:11.062424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f836df75-4fb9-4164-9a15-c372141b0099 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:11.069902 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f836df75-4fb9-4164-9a15-c372141b0099 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:11.071117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f836df75-4fb9-4164-9a15-c372141b0099 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:11.072659 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f836df75-4fb9-4164-9a15-c372141b0099 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:11.073420 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f836df75-4fb9-4164-9a15-c372141b0099 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:11.174473 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2860fdcc-323b-4cfb-9910-81fc71622563 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:11.178168 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=100 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:11.182624 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2860fdcc-323b-4cfb-9910-81fc71622563 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.218837 Jul 25 06:00:11.183276 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 58/117] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:10 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:11.286457 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-07ad0957-531b-4123-92fe-5cb374c8a076 req-c6e387e2-df4c-495b-83a0-d74d1468ad8c service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "b2dc5c54-08fc-4392-a4b9-f1970578ffb7", "tag": "c86fe1cd-ba90-483f-8c21-3093b1ee753e"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:11.308275 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-07ad0957-531b-4123-92fe-5cb374c8a076 req-c6e387e2-df4c-495b-83a0-d74d1468ad8c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:11.308275 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-07ad0957-531b-4123-92fe-5cb374c8a076 req-c6e387e2-df4c-495b-83a0-d74d1468ad8c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:11.318162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f836df75-4fb9-4164-9a15-c372141b0099 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:11.325883 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f836df75-4fb9-4164-9a15-c372141b0099 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.270407 Jul 25 06:00:11.334041 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 60/118] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:11 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:11.343072 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-07ad0957-531b-4123-92fe-5cb374c8a076 req-c6e387e2-df4c-495b-83a0-d74d1468ad8c service nova] Creating event network-changed:c86fe1cd-ba90-483f-8c21-3093b1ee753e for instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 on hv-cinder-84841 Jul 25 06:00:11.358262 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-07ad0957-531b-4123-92fe-5cb374c8a076 req-c6e387e2-df4c-495b-83a0-d74d1468ad8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075666 Jul 25 06:00:11.364992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 59/119] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:11.747155 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-fecc3241-c111-4520-9f36-3313fd27da58 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:11.747770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-fecc3241-c111-4520-9f36-3313fd27da58 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:11.754443 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fecc3241-c111-4520-9f36-3313fd27da58 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:11.755142 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fecc3241-c111-4520-9f36-3313fd27da58 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:11.755887 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fecc3241-c111-4520-9f36-3313fd27da58 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:11.756375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fecc3241-c111-4520-9f36-3313fd27da58 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:11.778657 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-bdb96c03-f67a-4a9a-8215-31e7bd06300a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:11.779605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-bdb96c03-f67a-4a9a-8215-31e7bd06300a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:11.786159 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bdb96c03-f67a-4a9a-8215-31e7bd06300a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:11.789184 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bdb96c03-f67a-4a9a-8215-31e7bd06300a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:11.789184 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bdb96c03-f67a-4a9a-8215-31e7bd06300a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:11.789184 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bdb96c03-f67a-4a9a-8215-31e7bd06300a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:11.926921 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-fecc3241-c111-4520-9f36-3313fd27da58 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:11.938072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-fecc3241-c111-4520-9f36-3313fd27da58 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.194948 Jul 25 06:00:11.938919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 61/120] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:11 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:11.946990 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7ab60644-7348-4810-95f4-ad707f477a8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:11.947588 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7ab60644-7348-4810-95f4-ad707f477a8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:11.953925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ab60644-7348-4810-95f4-ad707f477a8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:11.962062 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ab60644-7348-4810-95f4-ad707f477a8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:11.962062 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ab60644-7348-4810-95f4-ad707f477a8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:11.962062 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ab60644-7348-4810-95f4-ad707f477a8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:11.962328 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-bdb96c03-f67a-4a9a-8215-31e7bd06300a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:11.967461 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-bdb96c03-f67a-4a9a-8215-31e7bd06300a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.194946 Jul 25 06:00:11.968362 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 60/121] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:11 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:12.103110 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7ab60644-7348-4810-95f4-ad707f477a8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:12.113002 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7ab60644-7348-4810-95f4-ad707f477a8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:12.113366 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7ab60644-7348-4810-95f4-ad707f477a8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:12.114481 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7ab60644-7348-4810-95f4-ad707f477a8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.171571 Jul 25 06:00:12.115042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 62/122] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:11 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:00:12.199910 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-16d40eee-d1f4-49a9-9d87-04ad260f581c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:12.200544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-16d40eee-d1f4-49a9-9d87-04ad260f581c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:12.206891 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16d40eee-d1f4-49a9-9d87-04ad260f581c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:12.207326 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16d40eee-d1f4-49a9-9d87-04ad260f581c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:12.208090 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16d40eee-d1f4-49a9-9d87-04ad260f581c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:12.208550 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16d40eee-d1f4-49a9-9d87-04ad260f581c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:12.344584 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-16d40eee-d1f4-49a9-9d87-04ad260f581c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:12.352701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-16d40eee-d1f4-49a9-9d87-04ad260f581c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.156716 Jul 25 06:00:12.353470 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 61/123] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:12 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:12.358605 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-68034881-79d2-4266-8a41-99dbe1e31feb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:12.359210 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-68034881-79d2-4266-8a41-99dbe1e31feb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:12.365597 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-68034881-79d2-4266-8a41-99dbe1e31feb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:12.366036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-68034881-79d2-4266-8a41-99dbe1e31feb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:12.366815 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-68034881-79d2-4266-8a41-99dbe1e31feb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:12.367297 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-68034881-79d2-4266-8a41-99dbe1e31feb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:12.497544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-68034881-79d2-4266-8a41-99dbe1e31feb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:12.506282 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-68034881-79d2-4266-8a41-99dbe1e31feb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.151525 Jul 25 06:00:12.506944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 63/124] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:12 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:12.957651 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-710eab3e-236d-404f-8d68-207708a0f239 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:12.958537 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-710eab3e-236d-404f-8d68-207708a0f239 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:12.977202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-710eab3e-236d-404f-8d68-207708a0f239 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:12.981767 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-710eab3e-236d-404f-8d68-207708a0f239 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:12.984808 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-710eab3e-236d-404f-8d68-207708a0f239 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:12.986083 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-710eab3e-236d-404f-8d68-207708a0f239 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:12.990753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ebe4546a-a65e-4e0a-a120-82a589e333f7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:12.992000 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ebe4546a-a65e-4e0a-a120-82a589e333f7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:13.005043 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:13.028578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ebe4546a-a65e-4e0a-a120-82a589e333f7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:13.029238 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ebe4546a-a65e-4e0a-a120-82a589e333f7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:13.030701 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ebe4546a-a65e-4e0a-a120-82a589e333f7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:13.041479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ebe4546a-a65e-4e0a-a120-82a589e333f7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:13.322777 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-710eab3e-236d-404f-8d68-207708a0f239 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:13.354723 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-710eab3e-236d-404f-8d68-207708a0f239 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.402489 Jul 25 06:00:13.360429 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 62/125] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:12 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:13.381231 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3eb007dc-38be-4d7a-bd98-9a0d98e2c8cf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:13.384725 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3eb007dc-38be-4d7a-bd98-9a0d98e2c8cf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:13.398729 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3eb007dc-38be-4d7a-bd98-9a0d98e2c8cf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:13.402572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3eb007dc-38be-4d7a-bd98-9a0d98e2c8cf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:13.403345 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3eb007dc-38be-4d7a-bd98-9a0d98e2c8cf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:13.403789 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3eb007dc-38be-4d7a-bd98-9a0d98e2c8cf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:13.467215 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ebe4546a-a65e-4e0a-a120-82a589e333f7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:13.475048 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ebe4546a-a65e-4e0a-a120-82a589e333f7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.488460 Jul 25 06:00:13.477074 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 64/126] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:12 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:13.481820 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2660864c-3baf-4c3a-8ed5-188a8b76ff7f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:13.482636 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2660864c-3baf-4c3a-8ed5-188a8b76ff7f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:13.489400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2660864c-3baf-4c3a-8ed5-188a8b76ff7f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:13.490132 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2660864c-3baf-4c3a-8ed5-188a8b76ff7f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:13.491149 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2660864c-3baf-4c3a-8ed5-188a8b76ff7f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:13.491830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2660864c-3baf-4c3a-8ed5-188a8b76ff7f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:13.647709 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3eb007dc-38be-4d7a-bd98-9a0d98e2c8cf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:13.661252 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3eb007dc-38be-4d7a-bd98-9a0d98e2c8cf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:13.663091 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3eb007dc-38be-4d7a-bd98-9a0d98e2c8cf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:13.664842 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2660864c-3baf-4c3a-8ed5-188a8b76ff7f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:13.668351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3eb007dc-38be-4d7a-bd98-9a0d98e2c8cf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.302666 Jul 25 06:00:13.668351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 63/127] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:13 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:13.684660 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e1d283e4-72dc-4f00-85ac-d7dee46c9a8d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:13.686353 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2660864c-3baf-4c3a-8ed5-188a8b76ff7f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.206708 Jul 25 06:00:13.687394 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 65/128] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:13 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:13.699587 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e1d283e4-72dc-4f00-85ac-d7dee46c9a8d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:13.714863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e1d283e4-72dc-4f00-85ac-d7dee46c9a8d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:13.716430 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e1d283e4-72dc-4f00-85ac-d7dee46c9a8d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:13.720889 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e1d283e4-72dc-4f00-85ac-d7dee46c9a8d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:13.722034 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e1d283e4-72dc-4f00-85ac-d7dee46c9a8d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:14.100382 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-e1d283e4-72dc-4f00-85ac-d7dee46c9a8d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:14.114204 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e1d283e4-72dc-4f00-85ac-d7dee46c9a8d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.446184 Jul 25 06:00:14.114792 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 64/129] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:13 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:14.385898 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-eb3fc3e4-4362-4eab-825c-3e8e0177b3b1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:14.386579 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-eb3fc3e4-4362-4eab-825c-3e8e0177b3b1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:14.393696 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eb3fc3e4-4362-4eab-825c-3e8e0177b3b1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:14.394134 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eb3fc3e4-4362-4eab-825c-3e8e0177b3b1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:14.395419 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eb3fc3e4-4362-4eab-825c-3e8e0177b3b1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:14.395866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eb3fc3e4-4362-4eab-825c-3e8e0177b3b1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:14.496614 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-14561536-1dec-4958-b053-2bde28649b8a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:14.497617 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-14561536-1dec-4958-b053-2bde28649b8a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:14.515959 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-14561536-1dec-4958-b053-2bde28649b8a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:14.516445 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-14561536-1dec-4958-b053-2bde28649b8a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:14.518756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-14561536-1dec-4958-b053-2bde28649b8a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:14.518756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-14561536-1dec-4958-b053-2bde28649b8a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:14.649570 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-eb3fc3e4-4362-4eab-825c-3e8e0177b3b1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:14.658299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-eb3fc3e4-4362-4eab-825c-3e8e0177b3b1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.282881 Jul 25 06:00:14.659622 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 66/130] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:14 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:14.691066 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-64b046bc-c0c5-4f49-92ba-657677ce3fad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:14.692124 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-14561536-1dec-4958-b053-2bde28649b8a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:14.699261 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-64b046bc-c0c5-4f49-92ba-657677ce3fad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:14.709686 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-14561536-1dec-4958-b053-2bde28649b8a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.221175 Jul 25 06:00:14.710581 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 65/131] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:14 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:14.721181 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64b046bc-c0c5-4f49-92ba-657677ce3fad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:14.722845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64b046bc-c0c5-4f49-92ba-657677ce3fad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:14.723866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64b046bc-c0c5-4f49-92ba-657677ce3fad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:14.724542 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64b046bc-c0c5-4f49-92ba-657677ce3fad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:14.735084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1f3cf0b6-bbbb-48c0-8f40-f942b8332b44 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:14.735968 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1f3cf0b6-bbbb-48c0-8f40-f942b8332b44 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:14.743092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f3cf0b6-bbbb-48c0-8f40-f942b8332b44 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:14.743758 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f3cf0b6-bbbb-48c0-8f40-f942b8332b44 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:14.744779 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f3cf0b6-bbbb-48c0-8f40-f942b8332b44 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:14.745380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f3cf0b6-bbbb-48c0-8f40-f942b8332b44 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:14.804298 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:14.940590 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1f3cf0b6-bbbb-48c0-8f40-f942b8332b44 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:14.957329 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1f3cf0b6-bbbb-48c0-8f40-f942b8332b44 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.234825 Jul 25 06:00:14.970495 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 66/132] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:14 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:15.006562 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-64b046bc-c0c5-4f49-92ba-657677ce3fad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:15.022560 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-64b046bc-c0c5-4f49-92ba-657677ce3fad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:15.025062 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-64b046bc-c0c5-4f49-92ba-657677ce3fad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:15.026269 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-64b046bc-c0c5-4f49-92ba-657677ce3fad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.345455 Jul 25 06:00:15.026921 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 67/133] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:14 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:00:15.130793 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4f97ec40-8706-45df-b39f-aac8b21fac02 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:15.131424 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4f97ec40-8706-45df-b39f-aac8b21fac02 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:15.138259 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f97ec40-8706-45df-b39f-aac8b21fac02 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:15.138704 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f97ec40-8706-45df-b39f-aac8b21fac02 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:15.139501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f97ec40-8706-45df-b39f-aac8b21fac02 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:15.139924 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f97ec40-8706-45df-b39f-aac8b21fac02 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:15.302223 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4f97ec40-8706-45df-b39f-aac8b21fac02 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:15.311193 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4f97ec40-8706-45df-b39f-aac8b21fac02 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.184009 Jul 25 06:00:15.312243 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 67/134] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:15 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:15.676215 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-55be4b25-9933-4942-91d7-dd5d01fe9c92 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:15.676835 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-55be4b25-9933-4942-91d7-dd5d01fe9c92 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:15.685038 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-55be4b25-9933-4942-91d7-dd5d01fe9c92 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:15.686391 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-55be4b25-9933-4942-91d7-dd5d01fe9c92 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:15.687800 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-55be4b25-9933-4942-91d7-dd5d01fe9c92 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:15.688795 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-55be4b25-9933-4942-91d7-dd5d01fe9c92 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:15.727521 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f2d0c188-a641-498f-92c6-c28e34334af7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:15.728781 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f2d0c188-a641-498f-92c6-c28e34334af7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:15.739081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2d0c188-a641-498f-92c6-c28e34334af7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:15.739918 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2d0c188-a641-498f-92c6-c28e34334af7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:15.741286 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2d0c188-a641-498f-92c6-c28e34334af7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:15.741924 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2d0c188-a641-498f-92c6-c28e34334af7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:15.858626 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-55be4b25-9933-4942-91d7-dd5d01fe9c92 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:15.866399 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-55be4b25-9933-4942-91d7-dd5d01fe9c92 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.193897 Jul 25 06:00:15.876392 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 68/135] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:15 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:15.921676 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f2d0c188-a641-498f-92c6-c28e34334af7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:15.929250 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f2d0c188-a641-498f-92c6-c28e34334af7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.206174 Jul 25 06:00:15.929989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 68/136] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:15 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:15.975611 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f28d3994-23fd-46cb-8450-577cb83feee2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:15.976244 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f28d3994-23fd-46cb-8450-577cb83feee2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:15.987944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f28d3994-23fd-46cb-8450-577cb83feee2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:15.987944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f28d3994-23fd-46cb-8450-577cb83feee2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:15.987944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f28d3994-23fd-46cb-8450-577cb83feee2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:15.987944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f28d3994-23fd-46cb-8450-577cb83feee2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:16.047120 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fdc177a5-8ae1-4599-a1d3-d20f37903742 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:16.048086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-fdc177a5-8ae1-4599-a1d3-d20f37903742 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:16.058296 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fdc177a5-8ae1-4599-a1d3-d20f37903742 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:16.058989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fdc177a5-8ae1-4599-a1d3-d20f37903742 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:16.060393 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fdc177a5-8ae1-4599-a1d3-d20f37903742 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:16.060999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fdc177a5-8ae1-4599-a1d3-d20f37903742 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:16.154747 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f28d3994-23fd-46cb-8450-577cb83feee2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:16.165892 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f28d3994-23fd-46cb-8450-577cb83feee2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.194090 Jul 25 06:00:16.166477 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 69/137] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:15 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:16.262210 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-fdc177a5-8ae1-4599-a1d3-d20f37903742 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:16.272554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-fdc177a5-8ae1-4599-a1d3-d20f37903742 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:16.275761 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-fdc177a5-8ae1-4599-a1d3-d20f37903742 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:16.276916 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-fdc177a5-8ae1-4599-a1d3-d20f37903742 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.233802 Jul 25 06:00:16.277667 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 69/138] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:16 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:00:16.328122 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-cae364cf-a97a-4a37-97d9-0ebf86c44556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:16.328867 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cae364cf-a97a-4a37-97d9-0ebf86c44556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:16.335073 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cae364cf-a97a-4a37-97d9-0ebf86c44556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:16.335595 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cae364cf-a97a-4a37-97d9-0ebf86c44556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:16.337225 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cae364cf-a97a-4a37-97d9-0ebf86c44556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:16.337677 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cae364cf-a97a-4a37-97d9-0ebf86c44556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:16.586730 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-cae364cf-a97a-4a37-97d9-0ebf86c44556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:16.594500 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-cae364cf-a97a-4a37-97d9-0ebf86c44556 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.270331 Jul 25 06:00:16.595063 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 70/139] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:16 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:16.884569 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-05378b83-f26d-4450-bce6-345b30dfe1e8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:16.885185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-05378b83-f26d-4450-bce6-345b30dfe1e8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:16.904358 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-05378b83-f26d-4450-bce6-345b30dfe1e8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:16.904358 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-05378b83-f26d-4450-bce6-345b30dfe1e8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:16.904358 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-05378b83-f26d-4450-bce6-345b30dfe1e8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:16.904645 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-05378b83-f26d-4450-bce6-345b30dfe1e8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:16.946663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8a0286ff-bb9e-4b16-a7c2-6ced68b58ace tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:16.947308 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8a0286ff-bb9e-4b16-a7c2-6ced68b58ace tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:16.955437 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a0286ff-bb9e-4b16-a7c2-6ced68b58ace tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:16.956394 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a0286ff-bb9e-4b16-a7c2-6ced68b58ace tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:16.961733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a0286ff-bb9e-4b16-a7c2-6ced68b58ace tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:16.961733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a0286ff-bb9e-4b16-a7c2-6ced68b58ace tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:17.070758 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-05378b83-f26d-4450-bce6-345b30dfe1e8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:17.079071 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-05378b83-f26d-4450-bce6-345b30dfe1e8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.199613 Jul 25 06:00:17.080444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 70/140] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:16 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:17.159085 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8a0286ff-bb9e-4b16-a7c2-6ced68b58ace tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:17.167278 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8a0286ff-bb9e-4b16-a7c2-6ced68b58ace tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.224961 Jul 25 06:00:17.167845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 71/141] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:16 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:17.182865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e797e839-96e0-4342-b593-9097feb4081f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:17.183653 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e797e839-96e0-4342-b593-9097feb4081f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:17.190277 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e797e839-96e0-4342-b593-9097feb4081f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:17.190759 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e797e839-96e0-4342-b593-9097feb4081f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:17.191592 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e797e839-96e0-4342-b593-9097feb4081f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:17.195979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e797e839-96e0-4342-b593-9097feb4081f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:17.295575 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-235b7c7b-9509-4acf-ac06-fbc6dc58967a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:17.296378 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-235b7c7b-9509-4acf-ac06-fbc6dc58967a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:17.304070 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-235b7c7b-9509-4acf-ac06-fbc6dc58967a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:17.306334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-235b7c7b-9509-4acf-ac06-fbc6dc58967a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:17.308984 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-235b7c7b-9509-4acf-ac06-fbc6dc58967a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:17.309656 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-235b7c7b-9509-4acf-ac06-fbc6dc58967a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:17.471048 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-235b7c7b-9509-4acf-ac06-fbc6dc58967a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:17.488405 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-235b7c7b-9509-4acf-ac06-fbc6dc58967a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:17.490018 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-235b7c7b-9509-4acf-ac06-fbc6dc58967a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:17.493922 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-235b7c7b-9509-4acf-ac06-fbc6dc58967a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.202319 Jul 25 06:00:17.494870 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 72/142] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:17 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:00:17.583694 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-e797e839-96e0-4342-b593-9097feb4081f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:17.593480 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e797e839-96e0-4342-b593-9097feb4081f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.415180 Jul 25 06:00:17.594376 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 71/143] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:17 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:17.610786 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-562de3cc-cbd3-43f5-849e-77295f3c86f8 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:17.611616 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-562de3cc-cbd3-43f5-849e-77295f3c86f8 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:17.618662 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-562de3cc-cbd3-43f5-849e-77295f3c86f8 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:17.619114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-562de3cc-cbd3-43f5-849e-77295f3c86f8 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:17.619885 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-562de3cc-cbd3-43f5-849e-77295f3c86f8 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:17.620356 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-562de3cc-cbd3-43f5-849e-77295f3c86f8 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:17.624629 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:17.776094 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-562de3cc-cbd3-43f5-849e-77295f3c86f8 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:17.780926 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-7654417e-5ec1-41a6-ba53-022eef527d4f req-ca755d4e-2575-4423-9f26-b3047149b362 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "eb9a76df-da50-4f8c-8d6d-c3be003f0a25", "name": "network-vif-plugged", "status": "completed", "tag": "d356fd90-eba7-42c0-b027-05d5c7ddce5d"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:17.787747 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-562de3cc-cbd3-43f5-849e-77295f3c86f8 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.180658 Jul 25 06:00:17.788424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 73/144] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:17 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:17.788662 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-7654417e-5ec1-41a6-ba53-022eef527d4f req-ca755d4e-2575-4423-9f26-b3047149b362 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:17.789643 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-7654417e-5ec1-41a6-ba53-022eef527d4f req-ca755d4e-2575-4423-9f26-b3047149b362 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:17.803127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-7654417e-5ec1-41a6-ba53-022eef527d4f req-ca755d4e-2575-4423-9f26-b3047149b362 service nova] Creating event network-vif-plugged:d356fd90-eba7-42c0-b027-05d5c7ddce5d for instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 on hv-cinder-84841 Jul 25 06:00:17.808924 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-7654417e-5ec1-41a6-ba53-022eef527d4f req-ca755d4e-2575-4423-9f26-b3047149b362 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106676 Jul 25 06:00:17.809522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 72/145] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:00:18.103580 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-46ca6f8a-7187-479c-b8f2-0e43dd7254ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:18.109568 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-46ca6f8a-7187-479c-b8f2-0e43dd7254ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:18.121491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-46ca6f8a-7187-479c-b8f2-0e43dd7254ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:18.122748 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-46ca6f8a-7187-479c-b8f2-0e43dd7254ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:18.126540 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-46ca6f8a-7187-479c-b8f2-0e43dd7254ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:18.127169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-46ca6f8a-7187-479c-b8f2-0e43dd7254ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:18.185105 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-42b8a5af-b7b6-499b-b1b4-fdbb62cb1009 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:18.186048 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-42b8a5af-b7b6-499b-b1b4-fdbb62cb1009 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:18.192823 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-42b8a5af-b7b6-499b-b1b4-fdbb62cb1009 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:18.193559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-42b8a5af-b7b6-499b-b1b4-fdbb62cb1009 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:18.194380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-42b8a5af-b7b6-499b-b1b4-fdbb62cb1009 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:18.194872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-42b8a5af-b7b6-499b-b1b4-fdbb62cb1009 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:18.368818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-42b8a5af-b7b6-499b-b1b4-fdbb62cb1009 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:18.372049 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-46ca6f8a-7187-479c-b8f2-0e43dd7254ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:18.380529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-46ca6f8a-7187-479c-b8f2-0e43dd7254ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.286109 Jul 25 06:00:18.385237 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 74/146] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:18 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:18.386902 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-42b8a5af-b7b6-499b-b1b4-fdbb62cb1009 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.207330 Jul 25 06:00:18.387495 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 73/147] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:18 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:18.512915 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1e78aaf4-7e7d-4ef6-a2e0-ecd744e84117 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:18.514008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1e78aaf4-7e7d-4ef6-a2e0-ecd744e84117 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:18.520631 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1e78aaf4-7e7d-4ef6-a2e0-ecd744e84117 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:18.521281 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1e78aaf4-7e7d-4ef6-a2e0-ecd744e84117 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:18.522146 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1e78aaf4-7e7d-4ef6-a2e0-ecd744e84117 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:18.522652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1e78aaf4-7e7d-4ef6-a2e0-ecd744e84117 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:18.610977 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e4a5e4a7-30a1-47ed-a664-9b14f2a54b89 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:18.611595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e4a5e4a7-30a1-47ed-a664-9b14f2a54b89 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:18.617741 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:18.619720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e4a5e4a7-30a1-47ed-a664-9b14f2a54b89 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:18.620202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e4a5e4a7-30a1-47ed-a664-9b14f2a54b89 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:18.620967 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e4a5e4a7-30a1-47ed-a664-9b14f2a54b89 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:18.621559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e4a5e4a7-30a1-47ed-a664-9b14f2a54b89 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:18.700055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1e78aaf4-7e7d-4ef6-a2e0-ecd744e84117 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:18.712444 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1e78aaf4-7e7d-4ef6-a2e0-ecd744e84117 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:18.714856 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1e78aaf4-7e7d-4ef6-a2e0-ecd744e84117 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:18.717319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1e78aaf4-7e7d-4ef6-a2e0-ecd744e84117 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.209089 Jul 25 06:00:18.719277 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 75/148] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:18 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:18.806890 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-02106ba7-f4de-4048-be86-d05bc406d24d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:18.807732 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-02106ba7-f4de-4048-be86-d05bc406d24d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:18.817319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02106ba7-f4de-4048-be86-d05bc406d24d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:18.817992 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02106ba7-f4de-4048-be86-d05bc406d24d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:18.823583 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02106ba7-f4de-4048-be86-d05bc406d24d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:18.823583 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02106ba7-f4de-4048-be86-d05bc406d24d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:18.826214 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-e4a5e4a7-30a1-47ed-a664-9b14f2a54b89 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:18.840381 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e4a5e4a7-30a1-47ed-a664-9b14f2a54b89 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.232617 Jul 25 06:00:18.847912 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 74/149] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:18 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:18.971797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-02106ba7-f4de-4048-be86-d05bc406d24d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:18.981239 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-02106ba7-f4de-4048-be86-d05bc406d24d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.179690 Jul 25 06:00:18.981816 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 76/150] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:18 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:19.399804 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-03f2988b-92f7-4dd7-b7f3-9723349d0ab0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:19.400437 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-03f2988b-92f7-4dd7-b7f3-9723349d0ab0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:19.407875 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8a153ff9-652a-438f-b717-37350e3b6fc7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:19.408562 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8a153ff9-652a-438f-b717-37350e3b6fc7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:19.408968 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-03f2988b-92f7-4dd7-b7f3-9723349d0ab0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:19.409560 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-03f2988b-92f7-4dd7-b7f3-9723349d0ab0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:19.412396 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-03f2988b-92f7-4dd7-b7f3-9723349d0ab0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:19.412396 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-03f2988b-92f7-4dd7-b7f3-9723349d0ab0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:19.417764 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a153ff9-652a-438f-b717-37350e3b6fc7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:19.418403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a153ff9-652a-438f-b717-37350e3b6fc7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:19.419185 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a153ff9-652a-438f-b717-37350e3b6fc7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:19.419613 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8a153ff9-652a-438f-b717-37350e3b6fc7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:19.583647 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-03f2988b-92f7-4dd7-b7f3-9723349d0ab0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:19.586102 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8a153ff9-652a-438f-b717-37350e3b6fc7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:19.591579 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-03f2988b-92f7-4dd7-b7f3-9723349d0ab0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.196496 Jul 25 06:00:19.592181 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 75/151] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:19 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:19.593884 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8a153ff9-652a-438f-b717-37350e3b6fc7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.193080 Jul 25 06:00:19.594714 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 77/152] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:19 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:19.737151 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-db44323e-f811-443a-b25a-e075ae11eb69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:19.737826 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-db44323e-f811-443a-b25a-e075ae11eb69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:19.744351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db44323e-f811-443a-b25a-e075ae11eb69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:19.744801 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db44323e-f811-443a-b25a-e075ae11eb69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:19.745610 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db44323e-f811-443a-b25a-e075ae11eb69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:19.746043 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db44323e-f811-443a-b25a-e075ae11eb69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:19.839286 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-47b71b48-6ba2-4d60-8b1e-404f4da071a0 req-f23ba5c5-3872-4721-a9bc-d0d7d6218b49 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "ccf69bbe-b5ad-4061-9250-f2f3f0edee2d", "name": "network-vif-plugged", "status": "completed", "tag": "de159745-94e2-418c-9c37-533af5667e21"}, {"server_uuid": "a502c8d3-07ac-4e7f-9127-1281c94c5724", "name": "network-vif-plugged", "status": "completed", "tag": "a7211a3e-e5a1-4df6-b97c-4d903ce963ca"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:19.850985 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-47b71b48-6ba2-4d60-8b1e-404f4da071a0 req-f23ba5c5-3872-4721-a9bc-d0d7d6218b49 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:19.851873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-47b71b48-6ba2-4d60-8b1e-404f4da071a0 req-f23ba5c5-3872-4721-a9bc-d0d7d6218b49 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:19.869462 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-47b71b48-6ba2-4d60-8b1e-404f4da071a0 req-f23ba5c5-3872-4721-a9bc-d0d7d6218b49 service nova] Creating event network-vif-plugged:de159745-94e2-418c-9c37-533af5667e21 for instance ccf69bbe-b5ad-4061-9250-f2f3f0edee2d on hv-cinder-84841 Jul 25 06:00:19.871589 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-47b71b48-6ba2-4d60-8b1e-404f4da071a0 req-f23ba5c5-3872-4721-a9bc-d0d7d6218b49 service nova] Creating event network-vif-plugged:a7211a3e-e5a1-4df6-b97c-4d903ce963ca for instance a502c8d3-07ac-4e7f-9127-1281c94c5724 on hv-cinder-84841 Jul 25 06:00:19.879718 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-47b71b48-6ba2-4d60-8b1e-404f4da071a0 req-f23ba5c5-3872-4721-a9bc-d0d7d6218b49 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044772 Jul 25 06:00:19.887416 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 78/153] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:19.889149 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9dadb934-838a-4878-9db0-bef318f76b43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:19.890152 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9dadb934-838a-4878-9db0-bef318f76b43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:19.898598 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9dadb934-838a-4878-9db0-bef318f76b43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:19.899158 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9dadb934-838a-4878-9db0-bef318f76b43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:19.900397 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9dadb934-838a-4878-9db0-bef318f76b43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:19.901125 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9dadb934-838a-4878-9db0-bef318f76b43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:19.928085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-db44323e-f811-443a-b25a-e075ae11eb69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:19.933768 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=100 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:19.948723 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-db44323e-f811-443a-b25a-e075ae11eb69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:19.955632 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-db44323e-f811-443a-b25a-e075ae11eb69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:19.961115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-db44323e-f811-443a-b25a-e075ae11eb69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.225928 Jul 25 06:00:19.964715 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 76/154] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:19 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:19.999328 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f13059a3-5848-4caa-8273-e669efbb2108 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:20.000524 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f13059a3-5848-4caa-8273-e669efbb2108 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:20.007819 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f13059a3-5848-4caa-8273-e669efbb2108 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:20.008710 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f13059a3-5848-4caa-8273-e669efbb2108 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:20.009667 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f13059a3-5848-4caa-8273-e669efbb2108 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:20.010104 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f13059a3-5848-4caa-8273-e669efbb2108 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:20.113188 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9dadb934-838a-4878-9db0-bef318f76b43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:20.121267 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9dadb934-838a-4878-9db0-bef318f76b43 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1314 microversion: 2.1 time: 0.238574 Jul 25 06:00:20.122125 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 79/155] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:19 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:20.194115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f13059a3-5848-4caa-8273-e669efbb2108 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:20.214346 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f13059a3-5848-4caa-8273-e669efbb2108 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.218366 Jul 25 06:00:20.215172 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 77/156] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:19 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:20.614262 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-34fec54b-18b0-4177-bff5-6dbb228474ec tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:20.614997 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8f5790c1-e85e-41af-b68a-1c8287e00059 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:20.616036 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-34fec54b-18b0-4177-bff5-6dbb228474ec tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:20.616564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8f5790c1-e85e-41af-b68a-1c8287e00059 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:20.626944 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34fec54b-18b0-4177-bff5-6dbb228474ec tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:20.627448 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34fec54b-18b0-4177-bff5-6dbb228474ec tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:20.628237 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34fec54b-18b0-4177-bff5-6dbb228474ec tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:20.628700 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34fec54b-18b0-4177-bff5-6dbb228474ec tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:20.628918 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8f5790c1-e85e-41af-b68a-1c8287e00059 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:20.629184 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8f5790c1-e85e-41af-b68a-1c8287e00059 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:20.635695 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8f5790c1-e85e-41af-b68a-1c8287e00059 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:20.636170 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8f5790c1-e85e-41af-b68a-1c8287e00059 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:20.772154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-34fec54b-18b0-4177-bff5-6dbb228474ec tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:20.780600 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-34fec54b-18b0-4177-bff5-6dbb228474ec tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.171721 Jul 25 06:00:20.781168 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 78/157] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:20 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:20.820868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8f5790c1-e85e-41af-b68a-1c8287e00059 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:20.828310 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8f5790c1-e85e-41af-b68a-1c8287e00059 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.223382 Jul 25 06:00:20.828880 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 80/158] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:20 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:20.982232 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3f058010-26e4-4fa5-a247-ca21581633e3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:20.982836 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3f058010-26e4-4fa5-a247-ca21581633e3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:20.989026 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3f058010-26e4-4fa5-a247-ca21581633e3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:20.989533 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3f058010-26e4-4fa5-a247-ca21581633e3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:20.990223 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3f058010-26e4-4fa5-a247-ca21581633e3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:20.990648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3f058010-26e4-4fa5-a247-ca21581633e3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:21.135255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3f058010-26e4-4fa5-a247-ca21581633e3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:21.139106 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c3890698-eba2-4ad0-92e1-0a57a8dac3b4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:21.147106 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c3890698-eba2-4ad0-92e1-0a57a8dac3b4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:21.147241 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3f058010-26e4-4fa5-a247-ca21581633e3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:21.147241 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3f058010-26e4-4fa5-a247-ca21581633e3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:21.147241 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3f058010-26e4-4fa5-a247-ca21581633e3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.167345 Jul 25 06:00:21.147525 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c3890698-eba2-4ad0-92e1-0a57a8dac3b4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:21.147611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 79/159] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:20 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:21.147689 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c3890698-eba2-4ad0-92e1-0a57a8dac3b4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:21.147689 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c3890698-eba2-4ad0-92e1-0a57a8dac3b4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:21.147817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c3890698-eba2-4ad0-92e1-0a57a8dac3b4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:21.233151 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-01f71e27-555f-45ad-9ccd-091909b7fb5a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:21.233823 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-01f71e27-555f-45ad-9ccd-091909b7fb5a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:21.239879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-01f71e27-555f-45ad-9ccd-091909b7fb5a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:21.240368 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-01f71e27-555f-45ad-9ccd-091909b7fb5a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:21.241136 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-01f71e27-555f-45ad-9ccd-091909b7fb5a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:21.241571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-01f71e27-555f-45ad-9ccd-091909b7fb5a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:21.315314 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c3890698-eba2-4ad0-92e1-0a57a8dac3b4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:21.324718 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c3890698-eba2-4ad0-92e1-0a57a8dac3b4 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1502 microversion: 2.1 time: 0.190010 Jul 25 06:00:21.325309 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 81/160] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:21 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:21.376766 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-01f71e27-555f-45ad-9ccd-091909b7fb5a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:21.385312 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-01f71e27-555f-45ad-9ccd-091909b7fb5a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.156093 Jul 25 06:00:21.385980 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 80/161] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:21 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:21.798319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-fe89b0c6-3218-43f5-9434-d089ce79d9da tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:21.798933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-fe89b0c6-3218-43f5-9434-d089ce79d9da tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:21.814574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fe89b0c6-3218-43f5-9434-d089ce79d9da tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:21.821917 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fe89b0c6-3218-43f5-9434-d089ce79d9da tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:21.822779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fe89b0c6-3218-43f5-9434-d089ce79d9da tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:21.823209 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fe89b0c6-3218-43f5-9434-d089ce79d9da tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:21.846024 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1f6ae930-de9a-48a6-8d98-76c28460a4ab tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:21.847928 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1f6ae930-de9a-48a6-8d98-76c28460a4ab tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:21.857532 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f6ae930-de9a-48a6-8d98-76c28460a4ab tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:21.862357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f6ae930-de9a-48a6-8d98-76c28460a4ab tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:21.863275 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f6ae930-de9a-48a6-8d98-76c28460a4ab tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:21.863711 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f6ae930-de9a-48a6-8d98-76c28460a4ab tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:22.036822 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-fe89b0c6-3218-43f5-9434-d089ce79d9da tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:22.053076 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-fe89b0c6-3218-43f5-9434-d089ce79d9da tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.258662 Jul 25 06:00:22.067714 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 82/162] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:21 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:22.083277 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-281b05c8-c370-4bec-8c4d-637ffdc543ca req-3cc1fe36-77b4-41b5-a23f-0c594c27abf5 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf", "name": "network-vif-plugged", "status": "completed", "tag": "07e8aaba-4e29-4898-865b-3e4e9f738a49"}, {"server_uuid": "efb335ec-f540-494a-a2c7-c8db2f467c02", "name": "network-vif-plugged", "status": "completed", "tag": "d39effe6-1cf3-4165-9474-bb2a0cbbe15d"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:22.094092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1f6ae930-de9a-48a6-8d98-76c28460a4ab tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:22.103014 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1f6ae930-de9a-48a6-8d98-76c28460a4ab tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.260590 Jul 25 06:00:22.103463 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 81/163] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:21 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:22.104747 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-281b05c8-c370-4bec-8c4d-637ffdc543ca req-3cc1fe36-77b4-41b5-a23f-0c594c27abf5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:22.106579 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-281b05c8-c370-4bec-8c4d-637ffdc543ca req-3cc1fe36-77b4-41b5-a23f-0c594c27abf5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:22.125589 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-281b05c8-c370-4bec-8c4d-637ffdc543ca req-3cc1fe36-77b4-41b5-a23f-0c594c27abf5 service nova] Creating event network-vif-plugged:07e8aaba-4e29-4898-865b-3e4e9f738a49 for instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf on hv-cinder-84841 Jul 25 06:00:22.126284 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-281b05c8-c370-4bec-8c4d-637ffdc543ca req-3cc1fe36-77b4-41b5-a23f-0c594c27abf5 service nova] Creating event network-vif-plugged:d39effe6-1cf3-4165-9474-bb2a0cbbe15d for instance efb335ec-f540-494a-a2c7-c8db2f467c02 on hv-cinder-84841 Jul 25 06:00:22.133783 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-281b05c8-c370-4bec-8c4d-637ffdc543ca req-3cc1fe36-77b4-41b5-a23f-0c594c27abf5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064419 Jul 25 06:00:22.134549 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 83/164] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:22.165627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b80b14b9-936a-4e1e-8e76-baa38ff4e2ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:22.166495 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b80b14b9-936a-4e1e-8e76-baa38ff4e2ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:22.172960 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b80b14b9-936a-4e1e-8e76-baa38ff4e2ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:22.173448 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b80b14b9-936a-4e1e-8e76-baa38ff4e2ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:22.175054 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b80b14b9-936a-4e1e-8e76-baa38ff4e2ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:22.175054 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b80b14b9-936a-4e1e-8e76-baa38ff4e2ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:22.330407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b80b14b9-936a-4e1e-8e76-baa38ff4e2ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:22.339005 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b80b14b9-936a-4e1e-8e76-baa38ff4e2ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:22.340617 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b80b14b9-936a-4e1e-8e76-baa38ff4e2ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:22.341919 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b80b14b9-936a-4e1e-8e76-baa38ff4e2ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.181304 Jul 25 06:00:22.342597 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 82/165] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:22 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:22.403353 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4f62124c-c2ce-4322-878a-4700a49387f7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:22.404241 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4f62124c-c2ce-4322-878a-4700a49387f7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:22.410464 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4f62124c-c2ce-4322-878a-4700a49387f7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:22.410964 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4f62124c-c2ce-4322-878a-4700a49387f7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:22.411725 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4f62124c-c2ce-4322-878a-4700a49387f7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:22.412177 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4f62124c-c2ce-4322-878a-4700a49387f7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:22.582837 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4f62124c-c2ce-4322-878a-4700a49387f7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:22.589967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4f62124c-c2ce-4322-878a-4700a49387f7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.191158 Jul 25 06:00:22.590860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 84/166] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:22 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:23.073968 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-65f14fe9-8d82-4a04-95bb-609eb125827d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:23.074620 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-65f14fe9-8d82-4a04-95bb-609eb125827d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:23.080897 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-65f14fe9-8d82-4a04-95bb-609eb125827d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:23.081331 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-65f14fe9-8d82-4a04-95bb-609eb125827d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:23.082083 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-65f14fe9-8d82-4a04-95bb-609eb125827d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:23.082542 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-65f14fe9-8d82-4a04-95bb-609eb125827d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:23.120156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5f04cc7a-bfdf-48b1-a669-62d85ea3b597 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:23.121392 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5f04cc7a-bfdf-48b1-a669-62d85ea3b597 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:23.127762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5f04cc7a-bfdf-48b1-a669-62d85ea3b597 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:23.128472 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5f04cc7a-bfdf-48b1-a669-62d85ea3b597 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:23.129877 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5f04cc7a-bfdf-48b1-a669-62d85ea3b597 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:23.130518 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5f04cc7a-bfdf-48b1-a669-62d85ea3b597 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:23.233240 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-65f14fe9-8d82-4a04-95bb-609eb125827d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:23.240612 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-65f14fe9-8d82-4a04-95bb-609eb125827d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.171069 Jul 25 06:00:23.256206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 83/167] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:23 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:23.304645 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5f04cc7a-bfdf-48b1-a669-62d85ea3b597 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:23.312742 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5f04cc7a-bfdf-48b1-a669-62d85ea3b597 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.196564 Jul 25 06:00:23.313323 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 85/168] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:23 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:23.361729 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c114da70-91fd-4d79-a544-5bf7a8e184e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:23.362647 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c114da70-91fd-4d79-a544-5bf7a8e184e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:23.370759 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c114da70-91fd-4d79-a544-5bf7a8e184e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:23.371517 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c114da70-91fd-4d79-a544-5bf7a8e184e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:23.372536 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c114da70-91fd-4d79-a544-5bf7a8e184e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:23.373205 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c114da70-91fd-4d79-a544-5bf7a8e184e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:23.556473 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c114da70-91fd-4d79-a544-5bf7a8e184e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:23.564750 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c114da70-91fd-4d79-a544-5bf7a8e184e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:23.566279 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c114da70-91fd-4d79-a544-5bf7a8e184e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:23.567384 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c114da70-91fd-4d79-a544-5bf7a8e184e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.210388 Jul 25 06:00:23.567938 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 84/169] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:23 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:23.613868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-dffb6771-8052-4369-ace6-1d2f756d4ec6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:23.613868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-dffb6771-8052-4369-ace6-1d2f756d4ec6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:23.613868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:23.613868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dffb6771-8052-4369-ace6-1d2f756d4ec6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:23.614290 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dffb6771-8052-4369-ace6-1d2f756d4ec6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:23.615061 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dffb6771-8052-4369-ace6-1d2f756d4ec6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:23.615623 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dffb6771-8052-4369-ace6-1d2f756d4ec6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:23.770598 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-dffb6771-8052-4369-ace6-1d2f756d4ec6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:23.777934 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-dffb6771-8052-4369-ace6-1d2f756d4ec6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.175524 Jul 25 06:00:23.778501 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 86/170] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:23 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:24.150061 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-19a90105-fb70-46d1-b2ef-d21e7a996a04 req-04e41669-fa8a-4d5b-a8f1-c83f6c85ff4f service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "b2dc5c54-08fc-4392-a4b9-f1970578ffb7", "name": "network-vif-plugged", "status": "completed", "tag": "c86fe1cd-ba90-483f-8c21-3093b1ee753e"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:24.158447 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-19a90105-fb70-46d1-b2ef-d21e7a996a04 req-04e41669-fa8a-4d5b-a8f1-c83f6c85ff4f service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.158888 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-19a90105-fb70-46d1-b2ef-d21e7a996a04 req-04e41669-fa8a-4d5b-a8f1-c83f6c85ff4f service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.170662 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-19a90105-fb70-46d1-b2ef-d21e7a996a04 req-04e41669-fa8a-4d5b-a8f1-c83f6c85ff4f service nova] Creating event network-vif-plugged:c86fe1cd-ba90-483f-8c21-3093b1ee753e for instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 on hv-cinder-84841 Jul 25 06:00:24.175418 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-19a90105-fb70-46d1-b2ef-d21e7a996a04 req-04e41669-fa8a-4d5b-a8f1-c83f6c85ff4f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029810 Jul 25 06:00:24.175994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 85/171] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:24.258507 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-577776a0-47a3-495b-9ba2-58bae2c92ced tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:24.259815 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-577776a0-47a3-495b-9ba2-58bae2c92ced tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:24.268048 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-577776a0-47a3-495b-9ba2-58bae2c92ced tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.269786 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-577776a0-47a3-495b-9ba2-58bae2c92ced tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.271128 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-577776a0-47a3-495b-9ba2-58bae2c92ced tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.271561 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-577776a0-47a3-495b-9ba2-58bae2c92ced tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.312256 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c3f8f4bf-936f-4c22-ae5c-b538ad74b398 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f190>>, body: {"volumeAttachment": {"volumeId": "ed81ee8a-82cf-4713-a5e4-b076f7198250"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:24.314914 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c3f8f4bf-936f-4c22-ae5c-b538ad74b398 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:24.325654 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c3f8f4bf-936f-4c22-ae5c-b538ad74b398 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.326612 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c3f8f4bf-936f-4c22-ae5c-b538ad74b398 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.327860 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c3f8f4bf-936f-4c22-ae5c-b538ad74b398 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.328327 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c3f8f4bf-936f-4c22-ae5c-b538ad74b398 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.478938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-577776a0-47a3-495b-9ba2-58bae2c92ced tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:24.486515 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-577776a0-47a3-495b-9ba2-58bae2c92ced tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1322 microversion: 2.1 time: 0.232292 Jul 25 06:00:24.487187 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 87/172] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:24 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:24.492343 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-18208a4a-5eec-486e-ab7a-4820ebdfaee2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:24.493615 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-18208a4a-5eec-486e-ab7a-4820ebdfaee2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:24.499427 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-18208a4a-5eec-486e-ab7a-4820ebdfaee2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.499872 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-18208a4a-5eec-486e-ab7a-4820ebdfaee2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.500659 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-18208a4a-5eec-486e-ab7a-4820ebdfaee2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.501089 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-18208a4a-5eec-486e-ab7a-4820ebdfaee2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.677681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-18208a4a-5eec-486e-ab7a-4820ebdfaee2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:24.693987 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-18208a4a-5eec-486e-ab7a-4820ebdfaee2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1362 microversion: 2.1 time: 0.201782 Jul 25 06:00:24.694846 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 88/173] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:24 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:24.707298 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6967527f-c05a-45b8-ac46-46124b0e03f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:24.709293 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6967527f-c05a-45b8-ac46-46124b0e03f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:24.723631 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6967527f-c05a-45b8-ac46-46124b0e03f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.724427 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6967527f-c05a-45b8-ac46-46124b0e03f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.725375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6967527f-c05a-45b8-ac46-46124b0e03f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.725948 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6967527f-c05a-45b8-ac46-46124b0e03f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.866977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6967527f-c05a-45b8-ac46-46124b0e03f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:24.875605 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6967527f-c05a-45b8-ac46-46124b0e03f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:24.877159 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6967527f-c05a-45b8-ac46-46124b0e03f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:24.878264 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6967527f-c05a-45b8-ac46-46124b0e03f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.180979 Jul 25 06:00:24.884037 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 89/174] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:24 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:24.892068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c980b4a1-1b26-42dc-b211-bf1af96a7d51 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:24.892709 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c980b4a1-1b26-42dc-b211-bf1af96a7d51 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:24.900048 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c980b4a1-1b26-42dc-b211-bf1af96a7d51 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.900519 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c980b4a1-1b26-42dc-b211-bf1af96a7d51 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:24.901280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c980b4a1-1b26-42dc-b211-bf1af96a7d51 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:24.901713 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c980b4a1-1b26-42dc-b211-bf1af96a7d51 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:25.299127 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c980b4a1-1b26-42dc-b211-bf1af96a7d51 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:25.312726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c980b4a1-1b26-42dc-b211-bf1af96a7d51 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.432707 Jul 25 06:00:25.313914 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 90/175] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:24 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:25.502695 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-027277e1-a9fd-454c-916d-9aacb8cd48db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:25.503303 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-027277e1-a9fd-454c-916d-9aacb8cd48db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:25.509588 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-027277e1-a9fd-454c-916d-9aacb8cd48db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:25.510042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-027277e1-a9fd-454c-916d-9aacb8cd48db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:25.510779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-027277e1-a9fd-454c-916d-9aacb8cd48db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:25.511213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-027277e1-a9fd-454c-916d-9aacb8cd48db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:25.516306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:25.667725 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-027277e1-a9fd-454c-916d-9aacb8cd48db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:25.677613 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-027277e1-a9fd-454c-916d-9aacb8cd48db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1517 microversion: 2.1 time: 0.178686 Jul 25 06:00:25.678276 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 91/176] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:25 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:25.695924 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-07133c70-80c9-41c1-b828-d1abc98d4057 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Action: 'action', calling method: <bound method RescueController._rescue of <nova.api.openstack.compute.rescue.RescueController object at 0x7f6533ed9e80>>, body: {"rescue": {"adminPass": "***"}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:25.697594 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-07133c70-80c9-41c1-b828-d1abc98d4057 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:25.703860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-07133c70-80c9-41c1-b828-d1abc98d4057 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:25.704342 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-07133c70-80c9-41c1-b828-d1abc98d4057 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:25.705113 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-07133c70-80c9-41c1-b828-d1abc98d4057 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:25.705876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-07133c70-80c9-41c1-b828-d1abc98d4057 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:25.767254 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-07133c70-80c9-41c1-b828-d1abc98d4057 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lazy-loading 'flavor' on Instance uuid ccf69bbe-b5ad-4061-9250-f2f3f0edee2d {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:00:26.050128 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-07133c70-80c9-41c1-b828-d1abc98d4057 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "POST /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d/action" status: 200 len: 32 microversion: 2.1 time: 0.358086 Jul 25 06:00:26.051058 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 92/177] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:00:25 2022] POST /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d/action => generated 32 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 06:00:26.056453 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-22652fab-c1dd-4c89-b929-e89b4a85d9c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:26.057359 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-22652fab-c1dd-4c89-b929-e89b4a85d9c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:26.064065 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-22652fab-c1dd-4c89-b929-e89b4a85d9c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.064564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-22652fab-c1dd-4c89-b929-e89b4a85d9c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.065343 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-22652fab-c1dd-4c89-b929-e89b4a85d9c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.065753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-22652fab-c1dd-4c89-b929-e89b4a85d9c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.203026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-22652fab-c1dd-4c89-b929-e89b4a85d9c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:26.210589 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-22652fab-c1dd-4c89-b929-e89b4a85d9c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1549 microversion: 2.1 time: 0.158217 Jul 25 06:00:26.211244 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 93/178] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:26 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:26.216693 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7ceff9a4-6e09-4d55-97b3-f6e99b8b09c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:26.217887 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7ceff9a4-6e09-4d55-97b3-f6e99b8b09c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:26.224695 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ceff9a4-6e09-4d55-97b3-f6e99b8b09c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.225210 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ceff9a4-6e09-4d55-97b3-f6e99b8b09c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.226047 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ceff9a4-6e09-4d55-97b3-f6e99b8b09c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.226563 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ceff9a4-6e09-4d55-97b3-f6e99b8b09c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.360989 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7ceff9a4-6e09-4d55-97b3-f6e99b8b09c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:26.370207 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7ceff9a4-6e09-4d55-97b3-f6e99b8b09c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:26.371736 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7ceff9a4-6e09-4d55-97b3-f6e99b8b09c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:26.372859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7ceff9a4-6e09-4d55-97b3-f6e99b8b09c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.159990 Jul 25 06:00:26.373429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 94/179] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:26 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:26.377759 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-97a82189-a050-4a07-a1ac-b228b86f605a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:26.378539 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-97a82189-a050-4a07-a1ac-b228b86f605a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:26.385524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-97a82189-a050-4a07-a1ac-b228b86f605a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.386136 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-97a82189-a050-4a07-a1ac-b228b86f605a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.396525 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-97a82189-a050-4a07-a1ac-b228b86f605a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.396525 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-97a82189-a050-4a07-a1ac-b228b86f605a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.545335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-97a82189-a050-4a07-a1ac-b228b86f605a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:26.554657 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-97a82189-a050-4a07-a1ac-b228b86f605a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.180235 Jul 25 06:00:26.557150 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 95/180] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:26 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:26.570034 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e7b3af8e-0f22-4be2-a8cf-8cd980ca2f53 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method InterfaceAttachmentController.index of <nova.api.openstack.compute.attach_interfaces.InterfaceAttachmentController object at 0x7f6533e93e80>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:26.570537 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e7b3af8e-0f22-4be2-a8cf-8cd980ca2f53 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:26.594529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7b3af8e-0f22-4be2-a8cf-8cd980ca2f53 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.594990 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7b3af8e-0f22-4be2-a8cf-8cd980ca2f53 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.595779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7b3af8e-0f22-4be2-a8cf-8cd980ca2f53 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.596280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7b3af8e-0f22-4be2-a8cf-8cd980ca2f53 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.685806 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e7b3af8e-0f22-4be2-a8cf-8cd980ca2f53 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125592 Jul 25 06:00:26.686406 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 96/181] 10.222.0.40 () {58 vars in 1274 bytes} [Mon Jul 25 06:00:26 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:26.690966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-26944df5-5e0b-46f6-88e0-e035cc9d7a80 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:26.691766 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-26944df5-5e0b-46f6-88e0-e035cc9d7a80 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:26.699016 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26944df5-5e0b-46f6-88e0-e035cc9d7a80 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.699464 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26944df5-5e0b-46f6-88e0-e035cc9d7a80 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.705278 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26944df5-5e0b-46f6-88e0-e035cc9d7a80 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:26.705278 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26944df5-5e0b-46f6-88e0-e035cc9d7a80 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:26.979300 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-26944df5-5e0b-46f6-88e0-e035cc9d7a80 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:26.991728 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-26944df5-5e0b-46f6-88e0-e035cc9d7a80 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1366 microversion: 2.1 time: 0.304258 Jul 25 06:00:26.992729 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 97/182] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:26 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:27.393025 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-52ebfc45-f4a6-4b13-b829-7e4833daa07c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:27.394680 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-52ebfc45-f4a6-4b13-b829-7e4833daa07c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:27.404853 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-52ebfc45-f4a6-4b13-b829-7e4833daa07c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:27.405793 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-52ebfc45-f4a6-4b13-b829-7e4833daa07c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:27.407789 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-52ebfc45-f4a6-4b13-b829-7e4833daa07c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:27.408409 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-52ebfc45-f4a6-4b13-b829-7e4833daa07c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:27.682025 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-52ebfc45-f4a6-4b13-b829-7e4833daa07c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:27.690232 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-52ebfc45-f4a6-4b13-b829-7e4833daa07c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:27.691752 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-52ebfc45-f4a6-4b13-b829-7e4833daa07c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:27.705693 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c3f8f4bf-936f-4c22-ae5c-b538ad74b398 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "POST /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.398233 Jul 25 06:00:27.706692 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 86/183] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:00:24 2022] POST /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25/os-volume_attachments => generated 194 bytes in 3401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:27.709647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-52ebfc45-f4a6-4b13-b829-7e4833daa07c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.322417 Jul 25 06:00:27.718803 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-03023c77-8fd2-4a89-a0f0-f208cd049094 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:27.719759 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-03023c77-8fd2-4a89-a0f0-f208cd049094 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:27.724272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 98/184] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:27 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:27.730127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-03023c77-8fd2-4a89-a0f0-f208cd049094 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:27.731075 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-03023c77-8fd2-4a89-a0f0-f208cd049094 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:27.732687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-03023c77-8fd2-4a89-a0f0-f208cd049094 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:27.733382 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-03023c77-8fd2-4a89-a0f0-f208cd049094 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:28.012777 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-01f4fe33-ae42-4b38-a620-dbe186ddc792 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:28.013675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-01f4fe33-ae42-4b38-a620-dbe186ddc792 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:28.021178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01f4fe33-ae42-4b38-a620-dbe186ddc792 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:28.022751 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01f4fe33-ae42-4b38-a620-dbe186ddc792 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:28.029127 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01f4fe33-ae42-4b38-a620-dbe186ddc792 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:28.034670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01f4fe33-ae42-4b38-a620-dbe186ddc792 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:28.058479 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-03023c77-8fd2-4a89-a0f0-f208cd049094 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:28.069295 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-03023c77-8fd2-4a89-a0f0-f208cd049094 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.361115 Jul 25 06:00:28.070093 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 87/185] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:27 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:28.189801 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-01f4fe33-ae42-4b38-a620-dbe186ddc792 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:28.197881 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-01f4fe33-ae42-4b38-a620-dbe186ddc792 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1555 microversion: 2.1 time: 0.189695 Jul 25 06:00:28.198460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 99/186] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:28 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:28.217554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-04440a63-ad50-49c9-871b-6dbca1484867 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method InterfaceAttachmentController.index of <nova.api.openstack.compute.attach_interfaces.InterfaceAttachmentController object at 0x7f6533f0dd90>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:28.218046 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-04440a63-ad50-49c9-871b-6dbca1484867 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:28.226630 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-04440a63-ad50-49c9-871b-6dbca1484867 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:28.227801 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-04440a63-ad50-49c9-871b-6dbca1484867 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:28.228971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-04440a63-ad50-49c9-871b-6dbca1484867 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:28.229596 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-04440a63-ad50-49c9-871b-6dbca1484867 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:28.336565 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-04440a63-ad50-49c9-871b-6dbca1484867 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125196 Jul 25 06:00:28.337653 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 88/187] 10.222.0.40 () {58 vars in 1274 bytes} [Mon Jul 25 06:00:28 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:28.733599 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ea4e1427-cfbf-46cf-8eb2-fb261b847483 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:28.734123 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ea4e1427-cfbf-46cf-8eb2-fb261b847483 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:28.741191 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ea4e1427-cfbf-46cf-8eb2-fb261b847483 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:28.741866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ea4e1427-cfbf-46cf-8eb2-fb261b847483 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:28.742775 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ea4e1427-cfbf-46cf-8eb2-fb261b847483 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:28.745619 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ea4e1427-cfbf-46cf-8eb2-fb261b847483 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:28.870426 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-85735995-d71e-4cd5-a2e3-729ff29ac92d req-4f239332-5580-41ec-bdcf-3658a3bcb57f service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "a502c8d3-07ac-4e7f-9127-1281c94c5724", "tag": "a7211a3e-e5a1-4df6-b97c-4d903ce963ca"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:28.890895 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-85735995-d71e-4cd5-a2e3-729ff29ac92d req-4f239332-5580-41ec-bdcf-3658a3bcb57f service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:28.891597 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-85735995-d71e-4cd5-a2e3-729ff29ac92d req-4f239332-5580-41ec-bdcf-3658a3bcb57f service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:28.921379 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-85735995-d71e-4cd5-a2e3-729ff29ac92d req-4f239332-5580-41ec-bdcf-3658a3bcb57f service nova] Creating event network-changed:a7211a3e-e5a1-4df6-b97c-4d903ce963ca for instance a502c8d3-07ac-4e7f-9127-1281c94c5724 on hv-cinder-84841 Jul 25 06:00:28.933232 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-85735995-d71e-4cd5-a2e3-729ff29ac92d req-4f239332-5580-41ec-bdcf-3658a3bcb57f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067185 Jul 25 06:00:28.936641 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 89/188] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:29.088171 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-684a574f-cb50-4503-8457-f048c13d44a9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:29.089076 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-684a574f-cb50-4503-8457-f048c13d44a9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:29.097860 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-684a574f-cb50-4503-8457-f048c13d44a9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:29.103478 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-684a574f-cb50-4503-8457-f048c13d44a9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:29.104660 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-684a574f-cb50-4503-8457-f048c13d44a9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:29.105273 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-684a574f-cb50-4503-8457-f048c13d44a9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:29.115063 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ea4e1427-cfbf-46cf-8eb2-fb261b847483 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:29.129621 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ea4e1427-cfbf-46cf-8eb2-fb261b847483 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:29.131347 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ea4e1427-cfbf-46cf-8eb2-fb261b847483 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:29.135365 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ea4e1427-cfbf-46cf-8eb2-fb261b847483 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1406 microversion: 2.20 time: 0.407723 Jul 25 06:00:29.160840 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 100/189] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:28 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:29.455814 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-684a574f-cb50-4503-8457-f048c13d44a9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:29.470302 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-684a574f-cb50-4503-8457-f048c13d44a9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.386089 Jul 25 06:00:29.482605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 90/190] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:29 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:30.156564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-88f4eca7-51e2-48d5-99f7-6965a82ee90f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:30.158267 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-88f4eca7-51e2-48d5-99f7-6965a82ee90f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:30.165560 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88f4eca7-51e2-48d5-99f7-6965a82ee90f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:30.166511 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88f4eca7-51e2-48d5-99f7-6965a82ee90f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:30.167495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88f4eca7-51e2-48d5-99f7-6965a82ee90f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:30.168198 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88f4eca7-51e2-48d5-99f7-6965a82ee90f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:30.489987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ca47b551-bf8a-4ec7-ac5f-cc26ef3d91ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:30.490601 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ca47b551-bf8a-4ec7-ac5f-cc26ef3d91ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:30.506304 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ca47b551-bf8a-4ec7-ac5f-cc26ef3d91ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:30.508902 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ca47b551-bf8a-4ec7-ac5f-cc26ef3d91ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:30.510689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ca47b551-bf8a-4ec7-ac5f-cc26ef3d91ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:30.511356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ca47b551-bf8a-4ec7-ac5f-cc26ef3d91ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:30.536705 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-88f4eca7-51e2-48d5-99f7-6965a82ee90f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:30.552781 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-88f4eca7-51e2-48d5-99f7-6965a82ee90f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:30.554534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-88f4eca7-51e2-48d5-99f7-6965a82ee90f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:30.559322 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-88f4eca7-51e2-48d5-99f7-6965a82ee90f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1597 microversion: 2.20 time: 0.405003 Jul 25 06:00:30.583780 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 101/191] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:00:30 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1597 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:00:30.599435 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d8dd805e-dbe5-45b4-a803-9c01887bc5b0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method InterfaceAttachmentController.index of <nova.api.openstack.compute.attach_interfaces.InterfaceAttachmentController object at 0x7f6533e93e80>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:30.600457 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d8dd805e-dbe5-45b4-a803-9c01887bc5b0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:30.621889 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d8dd805e-dbe5-45b4-a803-9c01887bc5b0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:30.629478 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d8dd805e-dbe5-45b4-a803-9c01887bc5b0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:30.630491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d8dd805e-dbe5-45b4-a803-9c01887bc5b0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:30.634097 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d8dd805e-dbe5-45b4-a803-9c01887bc5b0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:30.810512 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ca47b551-bf8a-4ec7-ac5f-cc26ef3d91ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:30.819724 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ca47b551-bf8a-4ec7-ac5f-cc26ef3d91ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.334658 Jul 25 06:00:30.839606 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 91/192] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:30 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:30.859020 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d8dd805e-dbe5-45b4-a803-9c01887bc5b0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.273865 Jul 25 06:00:30.866255 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 102/193] 10.222.0.40 () {60 vars in 1315 bytes} [Mon Jul 25 06:00:30 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-interface => generated 284 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:00:31.022453 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-979f1be2-3995-456d-9828-96a2a0f9a0ac req-3e63b3ae-aea8-434c-8787-bf4f0d79f9c8 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "efb335ec-f540-494a-a2c7-c8db2f467c02", "tag": "d39effe6-1cf3-4165-9474-bb2a0cbbe15d"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:31.044868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-979f1be2-3995-456d-9828-96a2a0f9a0ac req-3e63b3ae-aea8-434c-8787-bf4f0d79f9c8 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:31.045546 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-979f1be2-3995-456d-9828-96a2a0f9a0ac req-3e63b3ae-aea8-434c-8787-bf4f0d79f9c8 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:31.068075 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-979f1be2-3995-456d-9828-96a2a0f9a0ac req-3e63b3ae-aea8-434c-8787-bf4f0d79f9c8 service nova] Creating event network-changed:d39effe6-1cf3-4165-9474-bb2a0cbbe15d for instance efb335ec-f540-494a-a2c7-c8db2f467c02 on hv-cinder-84841 Jul 25 06:00:31.077902 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-979f1be2-3995-456d-9828-96a2a0f9a0ac req-3e63b3ae-aea8-434c-8787-bf4f0d79f9c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058956 Jul 25 06:00:31.091591 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 92/194] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:31.847927 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f0fad7ce-08ab-4926-8913-215246c39331 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:31.849280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f0fad7ce-08ab-4926-8913-215246c39331 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:31.868352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0fad7ce-08ab-4926-8913-215246c39331 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:31.869205 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0fad7ce-08ab-4926-8913-215246c39331 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:31.870068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0fad7ce-08ab-4926-8913-215246c39331 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:31.870615 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0fad7ce-08ab-4926-8913-215246c39331 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:32.081303 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f0fad7ce-08ab-4926-8913-215246c39331 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:32.091145 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f0fad7ce-08ab-4926-8913-215246c39331 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.255169 Jul 25 06:00:32.092397 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 103/195] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:31 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:33.109956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9efb2a02-c2c0-4303-8821-572293524b6c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:33.110571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9efb2a02-c2c0-4303-8821-572293524b6c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:33.116956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9efb2a02-c2c0-4303-8821-572293524b6c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:33.118220 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9efb2a02-c2c0-4303-8821-572293524b6c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:33.121536 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9efb2a02-c2c0-4303-8821-572293524b6c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:33.121536 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9efb2a02-c2c0-4303-8821-572293524b6c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:33.192769 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-1ca387df-bec0-4620-b58b-56043081e486 req-842237d7-80c9-4616-9cb9-345a99546db2 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "b2dc5c54-08fc-4392-a4b9-f1970578ffb7", "tag": "c86fe1cd-ba90-483f-8c21-3093b1ee753e"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:33.208038 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-1ca387df-bec0-4620-b58b-56043081e486 req-842237d7-80c9-4616-9cb9-345a99546db2 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:33.209261 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-1ca387df-bec0-4620-b58b-56043081e486 req-842237d7-80c9-4616-9cb9-345a99546db2 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:33.229484 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-1ca387df-bec0-4620-b58b-56043081e486 req-842237d7-80c9-4616-9cb9-345a99546db2 service nova] Creating event network-changed:c86fe1cd-ba90-483f-8c21-3093b1ee753e for instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 on hv-cinder-84841 Jul 25 06:00:33.243127 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-1ca387df-bec0-4620-b58b-56043081e486 req-842237d7-80c9-4616-9cb9-345a99546db2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055790 Jul 25 06:00:33.244084 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 104/196] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:00:33.444915 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9efb2a02-c2c0-4303-8821-572293524b6c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:33.456132 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9efb2a02-c2c0-4303-8821-572293524b6c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.350170 Jul 25 06:00:33.467690 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 93/197] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:33 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:34.474919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d7a44ce7-34d2-4999-808c-ef2ee131f7fb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:34.475619 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d7a44ce7-34d2-4999-808c-ef2ee131f7fb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:34.482915 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d7a44ce7-34d2-4999-808c-ef2ee131f7fb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:34.483606 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d7a44ce7-34d2-4999-808c-ef2ee131f7fb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:34.484485 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d7a44ce7-34d2-4999-808c-ef2ee131f7fb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:34.485075 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d7a44ce7-34d2-4999-808c-ef2ee131f7fb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:34.638574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d7a44ce7-34d2-4999-808c-ef2ee131f7fb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:34.649053 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d7a44ce7-34d2-4999-808c-ef2ee131f7fb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.177827 Jul 25 06:00:34.653583 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 105/198] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:34 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:35.669691 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-432fffa6-21aa-4034-9325-3942e604bd3a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:35.670348 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-432fffa6-21aa-4034-9325-3942e604bd3a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:35.677041 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-432fffa6-21aa-4034-9325-3942e604bd3a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:35.677485 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-432fffa6-21aa-4034-9325-3942e604bd3a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:35.678373 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-432fffa6-21aa-4034-9325-3942e604bd3a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:35.678710 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-432fffa6-21aa-4034-9325-3942e604bd3a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:35.697710 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:35.830146 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-432fffa6-21aa-4034-9325-3942e604bd3a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:35.839202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-432fffa6-21aa-4034-9325-3942e604bd3a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.172022 Jul 25 06:00:35.839754 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 94/199] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:35 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:36.856535 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e382cdae-726b-4f4c-94bc-16c2f8e4e1ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:36.857758 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e382cdae-726b-4f4c-94bc-16c2f8e4e1ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:36.864342 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e382cdae-726b-4f4c-94bc-16c2f8e4e1ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.864798 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e382cdae-726b-4f4c-94bc-16c2f8e4e1ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:36.868230 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e382cdae-726b-4f4c-94bc-16c2f8e4e1ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:36.868230 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e382cdae-726b-4f4c-94bc-16c2f8e4e1ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:37.017890 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e382cdae-726b-4f4c-94bc-16c2f8e4e1ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:37.027222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e382cdae-726b-4f4c-94bc-16c2f8e4e1ce tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.174769 Jul 25 06:00:37.027723 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 106/200] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:36 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:38.046515 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8f6f7a95-4621-4750-9592-d1359ae42baf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:38.047661 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-8f6f7a95-4621-4750-9592-d1359ae42baf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:38.054979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8f6f7a95-4621-4750-9592-d1359ae42baf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.055429 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8f6f7a95-4621-4750-9592-d1359ae42baf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:38.062363 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8f6f7a95-4621-4750-9592-d1359ae42baf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.062363 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8f6f7a95-4621-4750-9592-d1359ae42baf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:38.194995 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8f6f7a95-4621-4750-9592-d1359ae42baf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:38.202968 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8f6f7a95-4621-4750-9592-d1359ae42baf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.162919 Jul 25 06:00:38.203547 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 95/201] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:38 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:38.748440 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-259a37be-0768-4970-acd6-5ec56be928c3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:38.749176 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-259a37be-0768-4970-acd6-5ec56be928c3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:38.756180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-259a37be-0768-4970-acd6-5ec56be928c3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.756635 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-259a37be-0768-4970-acd6-5ec56be928c3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:38.757407 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-259a37be-0768-4970-acd6-5ec56be928c3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:38.757851 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-259a37be-0768-4970-acd6-5ec56be928c3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:38.762715 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:38.784290 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-259a37be-0768-4970-acd6-5ec56be928c3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Going to try to terminate instance {{(pid=124917) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:00:39.047220 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-259a37be-0768-4970-acd6-5ec56be928c3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 204 len: 0 microversion: 2.1 time: 0.302932 Jul 25 06:00:39.047796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 107/202] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:00:38 2022] DELETE /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:00:39.056151 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2ebe35e5-6db2-4200-9b66-672d940b686f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:39.057400 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2ebe35e5-6db2-4200-9b66-672d940b686f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:39.063925 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ebe35e5-6db2-4200-9b66-672d940b686f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.064411 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ebe35e5-6db2-4200-9b66-672d940b686f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.065167 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ebe35e5-6db2-4200-9b66-672d940b686f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.065599 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ebe35e5-6db2-4200-9b66-672d940b686f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.202474 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2ebe35e5-6db2-4200-9b66-672d940b686f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:39.210590 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2ebe35e5-6db2-4200-9b66-672d940b686f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1554 microversion: 2.1 time: 0.158430 Jul 25 06:00:39.211165 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 96/203] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:39 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:39.220575 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-dfb71c62-0d0e-4673-8fe8-9b3a5165218e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:39.221280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-dfb71c62-0d0e-4673-8fe8-9b3a5165218e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:39.227508 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dfb71c62-0d0e-4673-8fe8-9b3a5165218e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.227974 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dfb71c62-0d0e-4673-8fe8-9b3a5165218e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.228896 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dfb71c62-0d0e-4673-8fe8-9b3a5165218e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:39.229381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dfb71c62-0d0e-4673-8fe8-9b3a5165218e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:39.367285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-dfb71c62-0d0e-4673-8fe8-9b3a5165218e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:39.375939 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-dfb71c62-0d0e-4673-8fe8-9b3a5165218e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.159454 Jul 25 06:00:39.376749 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 108/204] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:39 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:40.228095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f88d73a1-07d8-46f4-a38d-9d458082e21f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:40.229448 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f88d73a1-07d8-46f4-a38d-9d458082e21f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:40.235803 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f88d73a1-07d8-46f4-a38d-9d458082e21f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:40.236282 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f88d73a1-07d8-46f4-a38d-9d458082e21f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:40.237033 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f88d73a1-07d8-46f4-a38d-9d458082e21f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:40.237458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f88d73a1-07d8-46f4-a38d-9d458082e21f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:40.373052 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f88d73a1-07d8-46f4-a38d-9d458082e21f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:40.381302 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f88d73a1-07d8-46f4-a38d-9d458082e21f tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1554 microversion: 2.1 time: 0.156990 Jul 25 06:00:40.381877 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 97/205] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:40 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:40.393133 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e4c670d5-5dd4-4c0d-a2ae-5d75040f4a91 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:40.393744 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e4c670d5-5dd4-4c0d-a2ae-5d75040f4a91 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:40.400394 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e4c670d5-5dd4-4c0d-a2ae-5d75040f4a91 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:40.400867 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e4c670d5-5dd4-4c0d-a2ae-5d75040f4a91 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:40.401619 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e4c670d5-5dd4-4c0d-a2ae-5d75040f4a91 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:40.402053 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e4c670d5-5dd4-4c0d-a2ae-5d75040f4a91 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:40.535189 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e4c670d5-5dd4-4c0d-a2ae-5d75040f4a91 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:40.544044 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e4c670d5-5dd4-4c0d-a2ae-5d75040f4a91 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.154726 Jul 25 06:00:40.548712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 109/206] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:40 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:41.398244 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-bf49ad39-ef31-42cb-b252-c833f8b485e0 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:41.400178 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-bf49ad39-ef31-42cb-b252-c833f8b485e0 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:41.405875 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bf49ad39-ef31-42cb-b252-c833f8b485e0 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:41.406222 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bf49ad39-ef31-42cb-b252-c833f8b485e0 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:41.407056 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bf49ad39-ef31-42cb-b252-c833f8b485e0 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:41.409983 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bf49ad39-ef31-42cb-b252-c833f8b485e0 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:41.541766 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-bf49ad39-ef31-42cb-b252-c833f8b485e0 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:41.557142 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-bf49ad39-ef31-42cb-b252-c833f8b485e0 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1554 microversion: 2.1 time: 0.157061 Jul 25 06:00:41.557142 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 98/207] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:41 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:41.569269 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-42a9f22c-ab59-4ab8-be88-282ed28ff1d3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:41.570047 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-42a9f22c-ab59-4ab8-be88-282ed28ff1d3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:41.576378 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42a9f22c-ab59-4ab8-be88-282ed28ff1d3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:41.576902 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42a9f22c-ab59-4ab8-be88-282ed28ff1d3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:41.577730 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42a9f22c-ab59-4ab8-be88-282ed28ff1d3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:41.578225 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42a9f22c-ab59-4ab8-be88-282ed28ff1d3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:41.716550 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-42a9f22c-ab59-4ab8-be88-282ed28ff1d3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:41.723984 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-42a9f22c-ab59-4ab8-be88-282ed28ff1d3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.158684 Jul 25 06:00:41.724575 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 110/208] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:41 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:42.569247 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-bd675933-1b9c-4d48-ac5e-2abd80002211 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:42.569959 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-bd675933-1b9c-4d48-ac5e-2abd80002211 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:42.577533 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bd675933-1b9c-4d48-ac5e-2abd80002211 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:42.578027 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bd675933-1b9c-4d48-ac5e-2abd80002211 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:42.578776 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bd675933-1b9c-4d48-ac5e-2abd80002211 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:42.579336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bd675933-1b9c-4d48-ac5e-2abd80002211 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:42.724513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-bd675933-1b9c-4d48-ac5e-2abd80002211 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:42.740840 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-bd675933-1b9c-4d48-ac5e-2abd80002211 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1554 microversion: 2.1 time: 0.168078 Jul 25 06:00:42.741505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 99/209] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:42 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:42.742817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3a175839-6a31-4425-99ba-91f69660c22f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:42.743597 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3a175839-6a31-4425-99ba-91f69660c22f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:42.759420 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a175839-6a31-4425-99ba-91f69660c22f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:42.760784 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a175839-6a31-4425-99ba-91f69660c22f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:42.761878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a175839-6a31-4425-99ba-91f69660c22f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:42.762662 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a175839-6a31-4425-99ba-91f69660c22f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:42.900933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3a175839-6a31-4425-99ba-91f69660c22f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:42.908616 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3a175839-6a31-4425-99ba-91f69660c22f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.169997 Jul 25 06:00:42.909189 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 111/210] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:42 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:43.758946 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4dc8cde0-77f0-4a15-a89d-f3d18f126144 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:43.759662 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4dc8cde0-77f0-4a15-a89d-f3d18f126144 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:43.768979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4dc8cde0-77f0-4a15-a89d-f3d18f126144 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:43.769420 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4dc8cde0-77f0-4a15-a89d-f3d18f126144 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:43.770225 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4dc8cde0-77f0-4a15-a89d-f3d18f126144 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:43.770910 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4dc8cde0-77f0-4a15-a89d-f3d18f126144 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:43.926495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c2e3bf28-8f10-4ad5-a49a-1e1d4fcbfb90 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:43.927109 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c2e3bf28-8f10-4ad5-a49a-1e1d4fcbfb90 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:43.933910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c2e3bf28-8f10-4ad5-a49a-1e1d4fcbfb90 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:43.934363 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c2e3bf28-8f10-4ad5-a49a-1e1d4fcbfb90 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:43.935129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c2e3bf28-8f10-4ad5-a49a-1e1d4fcbfb90 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:43.938341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c2e3bf28-8f10-4ad5-a49a-1e1d4fcbfb90 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:43.975826 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4dc8cde0-77f0-4a15-a89d-f3d18f126144 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:43.984763 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4dc8cde0-77f0-4a15-a89d-f3d18f126144 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1554 microversion: 2.1 time: 0.229258 Jul 25 06:00:43.985780 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 100/211] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:43 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:44.100311 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c2e3bf28-8f10-4ad5-a49a-1e1d4fcbfb90 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:44.110868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c2e3bf28-8f10-4ad5-a49a-1e1d4fcbfb90 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.188315 Jul 25 06:00:44.111854 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 112/212] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:43 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:00:44.555207 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-c1d49ff0-51d1-41fd-a0e8-1804c31b6e02 req-48562257-79a5-4f7f-ba02-d3d1a85a99d5 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "eb9a76df-da50-4f8c-8d6d-c3be003f0a25", "name": "network-vif-deleted", "tag": "d356fd90-eba7-42c0-b027-05d5c7ddce5d"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:44.564597 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-c1d49ff0-51d1-41fd-a0e8-1804c31b6e02 req-48562257-79a5-4f7f-ba02-d3d1a85a99d5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:44.565324 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-c1d49ff0-51d1-41fd-a0e8-1804c31b6e02 req-48562257-79a5-4f7f-ba02-d3d1a85a99d5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:44.577379 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-c1d49ff0-51d1-41fd-a0e8-1804c31b6e02 req-48562257-79a5-4f7f-ba02-d3d1a85a99d5 service nova] Creating event network-vif-deleted:d356fd90-eba7-42c0-b027-05d5c7ddce5d for instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 on hv-cinder-84841 Jul 25 06:00:44.582942 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-c1d49ff0-51d1-41fd-a0e8-1804c31b6e02 req-48562257-79a5-4f7f-ba02-d3d1a85a99d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031422 Jul 25 06:00:44.583540 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 101/213] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:45.002305 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-77890914-494e-43bd-8faf-667241d7d23c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:45.002922 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-77890914-494e-43bd-8faf-667241d7d23c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:45.009179 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-77890914-494e-43bd-8faf-667241d7d23c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:45.009633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-77890914-494e-43bd-8faf-667241d7d23c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:45.010398 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-77890914-494e-43bd-8faf-667241d7d23c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:45.010823 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-77890914-494e-43bd-8faf-667241d7d23c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:45.112706 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-77890914-494e-43bd-8faf-667241d7d23c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:45.121283 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-77890914-494e-43bd-8faf-667241d7d23c tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1345 microversion: 2.1 time: 0.122997 Jul 25 06:00:45.121847 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 113/214] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:44 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:45.131163 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-592d1d6c-43fc-4740-b8a1-fd02c3f3e0ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:45.131850 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-592d1d6c-43fc-4740-b8a1-fd02c3f3e0ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:45.139370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-592d1d6c-43fc-4740-b8a1-fd02c3f3e0ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:45.139807 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-592d1d6c-43fc-4740-b8a1-fd02c3f3e0ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:45.140610 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-592d1d6c-43fc-4740-b8a1-fd02c3f3e0ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:45.141035 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-592d1d6c-43fc-4740-b8a1-fd02c3f3e0ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:45.272839 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-592d1d6c-43fc-4740-b8a1-fd02c3f3e0ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:45.280797 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-592d1d6c-43fc-4740-b8a1-fd02c3f3e0ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.154257 Jul 25 06:00:45.281364 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 102/215] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:45 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:46.138189 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1bdfb049-9999-407a-9da0-f9b94b4efc4b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:46.139387 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1bdfb049-9999-407a-9da0-f9b94b4efc4b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:46.145915 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1bdfb049-9999-407a-9da0-f9b94b4efc4b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:46.146365 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1bdfb049-9999-407a-9da0-f9b94b4efc4b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:46.147134 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1bdfb049-9999-407a-9da0-f9b94b4efc4b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:46.147573 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1bdfb049-9999-407a-9da0-f9b94b4efc4b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:46.185750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1bdfb049-9999-407a-9da0-f9b94b4efc4b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:46.186235 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1bdfb049-9999-407a-9da0-f9b94b4efc4b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:46.186710 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-1bdfb049-9999-407a-9da0-f9b94b4efc4b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lazy-loading 'fault' on Instance uuid eb9a76df-da50-4f8c-8d6d-c3be003f0a25 {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:00:46.233431 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1bdfb049-9999-407a-9da0-f9b94b4efc4b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1a33dc0f174cb1bdebf9e0c710509d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1484746571a24f5db36ed027469f88c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:46.242183 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1bdfb049-9999-407a-9da0-f9b94b4efc4b tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 200 len: 1350 microversion: 2.1 time: 0.108555 Jul 25 06:00:46.242762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 114/216] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:46 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:46.298723 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c866a1c9-9347-4a54-8851-9c1725520b48 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:46.299560 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c866a1c9-9347-4a54-8851-9c1725520b48 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:46.308051 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c866a1c9-9347-4a54-8851-9c1725520b48 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:46.314887 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c866a1c9-9347-4a54-8851-9c1725520b48 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:46.320796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c866a1c9-9347-4a54-8851-9c1725520b48 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:46.321248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c866a1c9-9347-4a54-8851-9c1725520b48 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:46.510979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c866a1c9-9347-4a54-8851-9c1725520b48 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:46.519162 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c866a1c9-9347-4a54-8851-9c1725520b48 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.224846 Jul 25 06:00:46.519733 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 103/217] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:46 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:47.260318 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-876e4761-fde2-4de4-a8f7-94049771afc3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:47.260936 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-876e4761-fde2-4de4-a8f7-94049771afc3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:47.267076 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-876e4761-fde2-4de4-a8f7-94049771afc3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.269029 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-876e4761-fde2-4de4-a8f7-94049771afc3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.269029 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-876e4761-fde2-4de4-a8f7-94049771afc3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.269029 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-876e4761-fde2-4de4-a8f7-94049771afc3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.282613 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-876e4761-fde2-4de4-a8f7-94049771afc3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] HTTP exception thrown: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-876e4761-fde2-4de4-a8f7-94049771afc3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Request method failure captured: Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 HTTP/1.1 Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFJBOqGLDazmPe6qBD8WUKKkhyMBkbqsZXS2q5kIVGE5TKzEhlMkLpng9Nxo5Qm6yFeNxWJfr3Z0HcfHdwWepTJMpadTx81UinkuF5l2tK7Qoe7YjqULhH9cEsI6TxQehjxhQYfGpw8Iiz4urm_xtIZ5GCGK7H-iZkC0ogmsKIe53w Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 1484746571a24f5db36ed027469f88c1 Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:00:47.287093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1484746571a24f5db36ed027469f88c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1484746571a24f5db36ed027469f88c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1484746571a24f5db36ed027469f88c1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1484746571a24f5db36ed027469f88c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 1484746571a24f5db36ed027469f88c1 Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-DeleteServersTestJSON-684506277-project Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: db1a33dc0f174cb1bdebf9e0c710509d Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-DeleteServersTestJSON-684506277-project Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:47.293628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'eb9a76df-da50-4f8c-8d6d-c3be003f0a25'} Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:00:47.294521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:47.295868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:00:47.297346 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-876e4761-fde2-4de4-a8f7-94049771afc3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Returning 404 to user: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:00:47.297346 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-876e4761-fde2-4de4-a8f7-94049771afc3 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 404 len: 111 microversion: 2.1 time: 0.032828 Jul 25 06:00:47.297346 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 115/218] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:47 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:00:47.403027 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-30bfcecf-5d1d-4ce2-9468-a14f9592e3e2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:47.403933 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-30bfcecf-5d1d-4ce2-9468-a14f9592e3e2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:47.410362 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-30bfcecf-5d1d-4ce2-9468-a14f9592e3e2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.410798 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-30bfcecf-5d1d-4ce2-9468-a14f9592e3e2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.411528 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-30bfcecf-5d1d-4ce2-9468-a14f9592e3e2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.412135 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-30bfcecf-5d1d-4ce2-9468-a14f9592e3e2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.425237 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-30bfcecf-5d1d-4ce2-9468-a14f9592e3e2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] HTTP exception thrown: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-30bfcecf-5d1d-4ce2-9468-a14f9592e3e2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Request method failure captured: Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25/os-volume_attachments HTTP/1.1 Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFJBOqGLDazmPe6qBD8WUKKkhyMBkbqsZXS2q5kIVGE5TKzEhlMkLpng9Nxo5Qm6yFeNxWJfr3Z0HcfHdwWepTJMpadTx81UinkuF5l2tK7Qoe7YjqULhH9cEsI6TxQehjxhQYfGpw8Iiz4urm_xtIZ5GCGK7H-iZkC0ogmsKIe53w Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: 1484746571a24f5db36ed027469f88c1 Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:00:47.429489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1484746571a24f5db36ed027469f88c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1484746571a24f5db36ed027469f88c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1484746571a24f5db36ed027469f88c1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1484746571a24f5db36ed027469f88c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: 1484746571a24f5db36ed027469f88c1 Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-DeleteServersTestJSON-684506277-project Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: db1a33dc0f174cb1bdebf9e0c710509d Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-DeleteServersTestJSON-684506277-project Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>> Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:47.430863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'server_id': 'eb9a76df-da50-4f8c-8d6d-c3be003f0a25'} Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:00:47.432067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:47.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:00:47.434684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-30bfcecf-5d1d-4ce2-9468-a14f9592e3e2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Returning 404 to user: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:00:47.434684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-30bfcecf-5d1d-4ce2-9468-a14f9592e3e2 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031837 Jul 25 06:00:47.434684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 104/219] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:00:47 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:00:47.537568 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-78748964-ea3d-45a2-9f15-833b51fd88fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:47.538131 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-78748964-ea3d-45a2-9f15-833b51fd88fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:47.545174 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78748964-ea3d-45a2-9f15-833b51fd88fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.545621 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78748964-ea3d-45a2-9f15-833b51fd88fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.546375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78748964-ea3d-45a2-9f15-833b51fd88fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:47.546799 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78748964-ea3d-45a2-9f15-833b51fd88fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:47.687743 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-78748964-ea3d-45a2-9f15-833b51fd88fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:47.695041 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-78748964-ea3d-45a2-9f15-833b51fd88fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.161364 Jul 25 06:00:47.695884 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 116/220] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:47 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:48.712065 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b9757b81-2d22-4ba4-b966-4cb3130dbedf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:48.713232 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b9757b81-2d22-4ba4-b966-4cb3130dbedf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:48.720320 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b9757b81-2d22-4ba4-b966-4cb3130dbedf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.720762 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b9757b81-2d22-4ba4-b966-4cb3130dbedf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.721556 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b9757b81-2d22-4ba4-b966-4cb3130dbedf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.721989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b9757b81-2d22-4ba4-b966-4cb3130dbedf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.860201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b9757b81-2d22-4ba4-b966-4cb3130dbedf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:48.860909 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1ee87b45-a458-4fce-a883-1355c4ceb1b5 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:48.861452 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1ee87b45-a458-4fce-a883-1355c4ceb1b5 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:48.867388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1ee87b45-a458-4fce-a883-1355c4ceb1b5 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.869431 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1ee87b45-a458-4fce-a883-1355c4ceb1b5 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.869553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b9757b81-2d22-4ba4-b966-4cb3130dbedf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.160249 Jul 25 06:00:48.869553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 105/221] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:48 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:48.869778 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1ee87b45-a458-4fce-a883-1355c4ceb1b5 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.869778 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1ee87b45-a458-4fce-a883-1355c4ceb1b5 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.882823 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-1ee87b45-a458-4fce-a883-1355c4ceb1b5 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] HTTP exception thrown: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1ee87b45-a458-4fce-a883-1355c4ceb1b5 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Request method failure captured: Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: DELETE /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 HTTP/1.1 Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFJBOqGLDazmPe6qBD8WUKKkhyMBkbqsZXS2q5kIVGE5TKzEhlMkLpng9Nxo5Qm6yFeNxWJfr3Z0HcfHdwWepTJMpadTx81UinkuF5l2tK7Qoe7YjqULhH9cEsI6TxQehjxhQYfGpw8Iiz4urm_xtIZ5GCGK7H-iZkC0ogmsKIe53w Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 1484746571a24f5db36ed027469f88c1 Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:00:48.884361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1484746571a24f5db36ed027469f88c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1484746571a24f5db36ed027469f88c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1484746571a24f5db36ed027469f88c1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1484746571a24f5db36ed027469f88c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 1484746571a24f5db36ed027469f88c1 Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-DeleteServersTestJSON-684506277-project Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: db1a33dc0f174cb1bdebf9e0c710509d Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-DeleteServersTestJSON-684506277-project Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>> Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:48.885994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'eb9a76df-da50-4f8c-8d6d-c3be003f0a25'} Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:00:48.886873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:48.888400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:00:48.889776 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1ee87b45-a458-4fce-a883-1355c4ceb1b5 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Returning 404 to user: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:00:48.889776 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1ee87b45-a458-4fce-a883-1355c4ceb1b5 tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 404 len: 111 microversion: 2.1 time: 0.028728 Jul 25 06:00:48.889776 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 117/222] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:00:48 2022] DELETE /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:00:48.894347 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-70c05077-9171-4120-a8dc-4de2353f3a4d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:48.894978 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-70c05077-9171-4120-a8dc-4de2353f3a4d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] [instance: eb9a76df-da50-4f8c-8d6d-c3be003f0a25] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:48.902081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-70c05077-9171-4120-a8dc-4de2353f3a4d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.910248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-70c05077-9171-4120-a8dc-4de2353f3a4d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.910248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-70c05077-9171-4120-a8dc-4de2353f3a4d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:48.910248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-70c05077-9171-4120-a8dc-4de2353f3a4d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:48.917201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-70c05077-9171-4120-a8dc-4de2353f3a4d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] HTTP exception thrown: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-70c05077-9171-4120-a8dc-4de2353f3a4d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Request method failure captured: Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 HTTP/1.1 Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFJBOqGLDazmPe6qBD8WUKKkhyMBkbqsZXS2q5kIVGE5TKzEhlMkLpng9Nxo5Qm6yFeNxWJfr3Z0HcfHdwWepTJMpadTx81UinkuF5l2tK7Qoe7YjqULhH9cEsI6TxQehjxhQYfGpw8Iiz4urm_xtIZ5GCGK7H-iZkC0ogmsKIe53w Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: 1484746571a24f5db36ed027469f88c1 Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:00:48.919301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1484746571a24f5db36ed027469f88c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1484746571a24f5db36ed027469f88c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1484746571a24f5db36ed027469f88c1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1484746571a24f5db36ed027469f88c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: 1484746571a24f5db36ed027469f88c1 Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-DeleteServersTestJSON-684506277 Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-DeleteServersTestJSON-684506277-project Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: db1a33dc0f174cb1bdebf9e0c710509d Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-DeleteServersTestJSON-684506277-project Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:48.920979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'eb9a76df-da50-4f8c-8d6d-c3be003f0a25'} Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:00:48.921856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. Jul 25 06:00:48.923334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:00:48.924593 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-70c05077-9171-4120-a8dc-4de2353f3a4d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] Returning 404 to user: Instance eb9a76df-da50-4f8c-8d6d-c3be003f0a25 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:00:48.924593 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-70c05077-9171-4120-a8dc-4de2353f3a4d tempest-DeleteServersTestJSON-684506277 tempest-DeleteServersTestJSON-684506277-project] 10.222.0.40 "GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25" status: 404 len: 111 microversion: 2.1 time: 0.030427 Jul 25 06:00:48.924593 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 106/223] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:48 2022] GET /compute/v2.1/servers/eb9a76df-da50-4f8c-8d6d-c3be003f0a25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:00:49.886593 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3fa9686c-9357-475b-9e71-e21789769581 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:49.887204 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3fa9686c-9357-475b-9e71-e21789769581 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:49.893457 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3fa9686c-9357-475b-9e71-e21789769581 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:49.894012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3fa9686c-9357-475b-9e71-e21789769581 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:49.894909 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3fa9686c-9357-475b-9e71-e21789769581 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:49.895567 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3fa9686c-9357-475b-9e71-e21789769581 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:50.123573 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3fa9686c-9357-475b-9e71-e21789769581 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:50.131207 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3fa9686c-9357-475b-9e71-e21789769581 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.249167 Jul 25 06:00:50.131768 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 118/224] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:49 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:51.150009 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9a3d0b40-b471-4bbc-a9d8-7790e8b885c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:51.151343 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9a3d0b40-b471-4bbc-a9d8-7790e8b885c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:51.157468 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=65 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:51.159574 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9a3d0b40-b471-4bbc-a9d8-7790e8b885c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:51.160314 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9a3d0b40-b471-4bbc-a9d8-7790e8b885c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:51.161371 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9a3d0b40-b471-4bbc-a9d8-7790e8b885c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:51.162018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9a3d0b40-b471-4bbc-a9d8-7790e8b885c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:51.343930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9a3d0b40-b471-4bbc-a9d8-7790e8b885c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:51.352640 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9a3d0b40-b471-4bbc-a9d8-7790e8b885c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.207399 Jul 25 06:00:51.354334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 107/225] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:51 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:52.373020 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5037fc3d-c921-40ed-9bbe-8c16cd4ca3a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:52.373626 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5037fc3d-c921-40ed-9bbe-8c16cd4ca3a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:52.380821 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5037fc3d-c921-40ed-9bbe-8c16cd4ca3a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:52.381456 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5037fc3d-c921-40ed-9bbe-8c16cd4ca3a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:52.382958 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5037fc3d-c921-40ed-9bbe-8c16cd4ca3a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:52.383408 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5037fc3d-c921-40ed-9bbe-8c16cd4ca3a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:52.538940 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5037fc3d-c921-40ed-9bbe-8c16cd4ca3a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:52.548137 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5037fc3d-c921-40ed-9bbe-8c16cd4ca3a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.178882 Jul 25 06:00:52.548829 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 119/226] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:52 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:53.566661 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8f67ab22-0107-4b23-a86f-4a9a9301eb71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:53.567604 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-8f67ab22-0107-4b23-a86f-4a9a9301eb71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:53.574594 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8f67ab22-0107-4b23-a86f-4a9a9301eb71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.575113 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8f67ab22-0107-4b23-a86f-4a9a9301eb71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.576122 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8f67ab22-0107-4b23-a86f-4a9a9301eb71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:53.576652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8f67ab22-0107-4b23-a86f-4a9a9301eb71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:53.752700 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8f67ab22-0107-4b23-a86f-4a9a9301eb71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:53.765293 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8f67ab22-0107-4b23-a86f-4a9a9301eb71 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.203124 Jul 25 06:00:53.775916 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 108/227] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:53 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:54.783837 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-40269f72-4810-4b70-add7-ae7bac5ca48b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:54.783837 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-40269f72-4810-4b70-add7-ae7bac5ca48b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:54.788733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:54.793162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-40269f72-4810-4b70-add7-ae7bac5ca48b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.793837 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-40269f72-4810-4b70-add7-ae7bac5ca48b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.794494 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-40269f72-4810-4b70-add7-ae7bac5ca48b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:54.794922 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-40269f72-4810-4b70-add7-ae7bac5ca48b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:54.933046 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-40269f72-4810-4b70-add7-ae7bac5ca48b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:54.943677 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-40269f72-4810-4b70-add7-ae7bac5ca48b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.164695 Jul 25 06:00:54.953292 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 120/228] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:54 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:55.961050 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5f8f9abd-40e0-4fc0-8946-c9ffd250c6f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:55.961713 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5f8f9abd-40e0-4fc0-8946-c9ffd250c6f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:55.969778 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f8f9abd-40e0-4fc0-8946-c9ffd250c6f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:55.970224 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f8f9abd-40e0-4fc0-8946-c9ffd250c6f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:55.971554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f8f9abd-40e0-4fc0-8946-c9ffd250c6f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:55.972003 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f8f9abd-40e0-4fc0-8946-c9ffd250c6f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:56.125535 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5f8f9abd-40e0-4fc0-8946-c9ffd250c6f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:56.133401 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5f8f9abd-40e0-4fc0-8946-c9ffd250c6f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.176709 Jul 25 06:00:56.133994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 109/229] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:55 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:57.152822 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8fbeab27-a222-45f4-bd8c-19855382b8c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:57.154051 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8fbeab27-a222-45f4-bd8c-19855382b8c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:57.160172 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbeab27-a222-45f4-bd8c-19855382b8c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.160626 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbeab27-a222-45f4-bd8c-19855382b8c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.161399 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbeab27-a222-45f4-bd8c-19855382b8c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:57.161834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbeab27-a222-45f4-bd8c-19855382b8c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:57.330944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8fbeab27-a222-45f4-bd8c-19855382b8c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:57.338930 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8fbeab27-a222-45f4-bd8c-19855382b8c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.192003 Jul 25 06:00:57.339510 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 121/230] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:57 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:58.186110 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8b797fd1-aef5-4132-a2df-5cbaaf9a97a4 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531ed05e0>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:58.270153 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8b797fd1-aef5-4132-a2df-5cbaaf9a97a4 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/931b2ad1-07a6-4eb2-9579-8a84921b7c7c" status: 200 len: 350 microversion: 2.1 time: 0.087837 Jul 25 06:00:58.270863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 110/231] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 06:00:58 2022] GET /compute/v2.1/os-volumes/931b2ad1-07a6-4eb2-9579-8a84921b7c7c => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:00:58.355107 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-06d61e30-8388-4945-bd48-138366f116bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:58.355722 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-06d61e30-8388-4945-bd48-138366f116bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:58.362443 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-06d61e30-8388-4945-bd48-138366f116bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:58.362895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-06d61e30-8388-4945-bd48-138366f116bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:58.363674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-06d61e30-8388-4945-bd48-138366f116bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:58.364087 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-06d61e30-8388-4945-bd48-138366f116bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:58.498642 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-06d61e30-8388-4945-bd48-138366f116bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:58.506074 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-06d61e30-8388-4945-bd48-138366f116bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.155241 Jul 25 06:00:58.506635 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 122/232] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:58 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:59.523722 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-29447e89-163a-4d27-b4fe-69ee4abae133 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:00:59.524368 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-29447e89-163a-4d27-b4fe-69ee4abae133 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:00:59.531451 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29447e89-163a-4d27-b4fe-69ee4abae133 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:59.531896 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29447e89-163a-4d27-b4fe-69ee4abae133 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:59.532679 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29447e89-163a-4d27-b4fe-69ee4abae133 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:00:59.533109 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29447e89-163a-4d27-b4fe-69ee4abae133 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:00:59.673155 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-29447e89-163a-4d27-b4fe-69ee4abae133 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:00:59.683169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-29447e89-163a-4d27-b4fe-69ee4abae133 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.163699 Jul 25 06:00:59.683665 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 111/233] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:00:59 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:00:59.892133 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-546720585", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "networks": [{"uuid": "bed4e1ff-978c-499b-96a3-5f6ed76b5a2b"}]}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:00:59.950717 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] validate_networks() for [('bed4e1ff-978c-499b-96a3-5f6ed76b5a2b', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:00:59.966624 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-17ed740a-a3ee-4508-8fe1-1f467d295cfa tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f65320db940>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:00.014358 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-17ed740a-a3ee-4508-8fe1-1f467d295cfa tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0bba3981-f6ff-472f-9dbb-103528780f44" status: 200 len: 351 microversion: 2.1 time: 0.051679 Jul 25 06:01:00.014982 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 112/234] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 06:00:59 2022] GET /compute/v2.1/os-volumes/0bba3981-f6ff-472f-9dbb-103528780f44 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:00.315155 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:01:00.315640 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:01:00.316132 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:01:00.316590 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:01:00.317008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:01:00.327362 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:00.330144 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:00.330144 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:00.330144 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:00.338502 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:00.350195 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Getting quotas for project 7d97f354896a4f1bbef0b4d1e6b99c27. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:01:00.355312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Getting quotas for user 5caf24262d214d9aa8cf9612582154f5 and project 7d97f354896a4f1bbef0b4d1e6b99c27. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:01:00.367865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:01:00.371088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:01:00.543558 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ee74deea-8516-43ad-a9a4-4a8efad4e7e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655073 Jul 25 06:01:00.544393 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 123/235] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:01:00.555247 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-664dbe00-59c2-43b2-b7a8-581941c6cf04 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:00.556245 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-664dbe00-59c2-43b2-b7a8-581941c6cf04 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:00.702318 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0d27194a-5cb0-4099-82f5-4ba24f123b1a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:00.702944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0d27194a-5cb0-4099-82f5-4ba24f123b1a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:00.709919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d27194a-5cb0-4099-82f5-4ba24f123b1a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:00.710659 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d27194a-5cb0-4099-82f5-4ba24f123b1a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:00.711574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d27194a-5cb0-4099-82f5-4ba24f123b1a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:00.713381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d27194a-5cb0-4099-82f5-4ba24f123b1a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:00.713593 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-664dbe00-59c2-43b2-b7a8-581941c6cf04 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:00.724040 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-664dbe00-59c2-43b2-b7a8-581941c6cf04 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1218 microversion: 2.1 time: 0.172943 Jul 25 06:01:00.724650 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 113/236] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:00 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1218 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:00.930236 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0d27194a-5cb0-4099-82f5-4ba24f123b1a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:00.943176 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0d27194a-5cb0-4099-82f5-4ba24f123b1a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1523 microversion: 2.1 time: 0.247589 Jul 25 06:01:00.944031 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 124/237] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:00 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:01.741380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-348ed194-9401-4a64-b257-edb0f2401476 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6532038c10>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:01.746075 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-12ed70be-06ca-4629-9838-8a3351563465 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:01.746679 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-12ed70be-06ca-4629-9838-8a3351563465 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:01.755660 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-12ed70be-06ca-4629-9838-8a3351563465 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.756105 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-12ed70be-06ca-4629-9838-8a3351563465 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:01.762239 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-12ed70be-06ca-4629-9838-8a3351563465 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.762239 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-12ed70be-06ca-4629-9838-8a3351563465 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:01.799637 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-348ed194-9401-4a64-b257-edb0f2401476 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/dd283251-9ad9-4ebb-a843-b1ebcc87c624" status: 200 len: 351 microversion: 2.1 time: 0.062110 Jul 25 06:01:01.804217 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 114/238] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 06:01:01 2022] GET /compute/v2.1/os-volumes/dd283251-9ad9-4ebb-a843-b1ebcc87c624 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:01.811997 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0a155f40-a3df-4a8a-850a-8bd211469f89 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531ed0430>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:01.848078 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-12ed70be-06ca-4629-9838-8a3351563465 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:01.858940 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-12ed70be-06ca-4629-9838-8a3351563465 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1222 microversion: 2.1 time: 0.117005 Jul 25 06:01:01.858940 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 125/239] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:01 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:01.902394 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0a155f40-a3df-4a8a-850a-8bd211469f89 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093856 Jul 25 06:01:01.903200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 115/240] 10.222.0.40 () {58 vars in 1133 bytes} [Mon Jul 25 06:01:01 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:01.916976 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-bfe6ba58-0d79-4f72-93e3-c110596af13f tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f65326dd430>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:01.962300 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ab34c559-6edf-4a66-b623-a1e99f79bdb3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:01.963024 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ab34c559-6edf-4a66-b623-a1e99f79bdb3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:01.971067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab34c559-6edf-4a66-b623-a1e99f79bdb3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.971544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab34c559-6edf-4a66-b623-a1e99f79bdb3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:01.975385 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab34c559-6edf-4a66-b623-a1e99f79bdb3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:01.976282 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab34c559-6edf-4a66-b623-a1e99f79bdb3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.001821 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-bfe6ba58-0d79-4f72-93e3-c110596af13f tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089529 Jul 25 06:01:02.002937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 126/241] 10.222.0.40 () {58 vars in 1148 bytes} [Mon Jul 25 06:01:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:02.014774 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d8aafba4-5716-4844-b6aa-b6568af0b527 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f65345ba160>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:02.110082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d8aafba4-5716-4844-b6aa-b6568af0b527 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.098850 Jul 25 06:01:02.110651 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 127/242] 10.222.0.40 () {58 vars in 1133 bytes} [Mon Jul 25 06:01:02 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:02.121830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f2ccca88-b0b5-4769-8333-3af8addda112 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f653280a310>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:02.126423 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ab34c559-6edf-4a66-b623-a1e99f79bdb3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:02.134695 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ab34c559-6edf-4a66-b623-a1e99f79bdb3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1503 microversion: 2.1 time: 0.177298 Jul 25 06:01:02.140294 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 116/243] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:01 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:02.151465 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4f2e08cb-479a-4480-a1d9-35148e3fdbda tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:02.152074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4f2e08cb-479a-4480-a1d9-35148e3fdbda tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:02.158731 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f2e08cb-479a-4480-a1d9-35148e3fdbda tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:02.158731 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f2e08cb-479a-4480-a1d9-35148e3fdbda tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.159280 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f2e08cb-479a-4480-a1d9-35148e3fdbda tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:02.159707 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f2e08cb-479a-4480-a1d9-35148e3fdbda tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.219270 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f2ccca88-b0b5-4769-8333-3af8addda112 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.101296 Jul 25 06:01:02.220019 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 128/244] 10.222.0.40 () {58 vars in 1166 bytes} [Mon Jul 25 06:01:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:02.232472 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f8b5fdb9-c7d8-4f77-91f6-d4c8e1f85bcc tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6532971700>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:02.322325 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f8b5fdb9-c7d8-4f77-91f6-d4c8e1f85bcc tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.093408 Jul 25 06:01:02.322917 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 129/245] 10.222.0.40 () {58 vars in 1169 bytes} [Mon Jul 25 06:01:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:02.335059 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b94aad33-94e1-43ee-ba44-963cf21841d5 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f65326dd8b0>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:02.422693 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b94aad33-94e1-43ee-ba44-963cf21841d5 tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091402 Jul 25 06:01:02.423264 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 130/246] 10.222.0.40 () {58 vars in 1154 bytes} [Mon Jul 25 06:01:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:02.442733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9412ac39-7080-4ab6-a496-d83bfb6c896e tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f65327445e0>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:02.533562 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9412ac39-7080-4ab6-a496-d83bfb6c896e tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.101610 Jul 25 06:01:02.534635 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 131/247] 10.222.0.40 () {58 vars in 1187 bytes} [Mon Jul 25 06:01:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:02.546076 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-eb4e0a19-97d0-4b61-92ad-f8419601cc1f tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f65327449d0>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:02.557391 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4f2e08cb-479a-4480-a1d9-35148e3fdbda tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:02.565719 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4f2e08cb-479a-4480-a1d9-35148e3fdbda tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1515 microversion: 2.1 time: 0.418900 Jul 25 06:01:02.566459 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 117/248] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:02 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1515 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:02.629521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-eb4e0a19-97d0-4b61-92ad-f8419601cc1f tempest-VolumesTestJSON-1778297548 tempest-VolumesTestJSON-1778297548-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087235 Jul 25 06:01:02.630100 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 132/249] 10.222.0.40 () {58 vars in 1154 bytes} [Mon Jul 25 06:01:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:02.878987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b5ab37fd-c17c-40c5-b5a4-28dea553e3af tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:02.880006 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b5ab37fd-c17c-40c5-b5a4-28dea553e3af tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:02.886605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b5ab37fd-c17c-40c5-b5a4-28dea553e3af tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:02.887054 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b5ab37fd-c17c-40c5-b5a4-28dea553e3af tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.887821 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b5ab37fd-c17c-40c5-b5a4-28dea553e3af tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:02.888295 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b5ab37fd-c17c-40c5-b5a4-28dea553e3af tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:02.892424 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=100 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:02.949856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b5ab37fd-c17c-40c5-b5a4-28dea553e3af tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:02.957464 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b5ab37fd-c17c-40c5-b5a4-28dea553e3af tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1270 microversion: 2.1 time: 0.085589 Jul 25 06:01:02.958238 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 118/250] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:02 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:03.975068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2ca3f0a9-5d3b-479a-bef8-690e97d5db7f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:03.975819 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2ca3f0a9-5d3b-479a-bef8-690e97d5db7f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:03.982205 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2ca3f0a9-5d3b-479a-bef8-690e97d5db7f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:03.982695 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2ca3f0a9-5d3b-479a-bef8-690e97d5db7f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:03.983464 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2ca3f0a9-5d3b-479a-bef8-690e97d5db7f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:03.983892 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2ca3f0a9-5d3b-479a-bef8-690e97d5db7f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:04.119716 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2ca3f0a9-5d3b-479a-bef8-690e97d5db7f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:04.128006 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2ca3f0a9-5d3b-479a-bef8-690e97d5db7f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1318 microversion: 2.1 time: 0.156950 Jul 25 06:01:04.128645 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 133/251] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:03 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:04.443822 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f9299a60-f2bc-4286-8a3a-5fa1759118b0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Action: 'action', calling method: <bound method RescueController._rescue of <nova.api.openstack.compute.rescue.RescueController object at 0x7f6533ed8e50>>, body: {"rescue": {"adminPass": "***"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:04.444861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f9299a60-f2bc-4286-8a3a-5fa1759118b0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:04.451901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f9299a60-f2bc-4286-8a3a-5fa1759118b0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:04.452366 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f9299a60-f2bc-4286-8a3a-5fa1759118b0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:04.453329 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f9299a60-f2bc-4286-8a3a-5fa1759118b0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:04.453759 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f9299a60-f2bc-4286-8a3a-5fa1759118b0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:04.487110 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-f9299a60-f2bc-4286-8a3a-5fa1759118b0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lazy-loading 'flavor' on Instance uuid 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:01:04.730389 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-860e2933-3eba-4f19-ab97-a400592ff464 req-e386069c-747a-4d30-b6cd-41b54dfc5201 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "2abbf803-6310-4fcd-bc09-ff506fab0a30", "tag": "c773c2c6-02cb-4486-8cdb-0116d19cfa92"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:04.742187 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-860e2933-3eba-4f19-ab97-a400592ff464 req-e386069c-747a-4d30-b6cd-41b54dfc5201 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:04.742778 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-860e2933-3eba-4f19-ab97-a400592ff464 req-e386069c-747a-4d30-b6cd-41b54dfc5201 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:04.768200 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-860e2933-3eba-4f19-ab97-a400592ff464 req-e386069c-747a-4d30-b6cd-41b54dfc5201 service nova] Creating event network-changed:c773c2c6-02cb-4486-8cdb-0116d19cfa92 for instance 2abbf803-6310-4fcd-bc09-ff506fab0a30 on hv-cinder-84841 Jul 25 06:01:04.775317 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-860e2933-3eba-4f19-ab97-a400592ff464 req-e386069c-747a-4d30-b6cd-41b54dfc5201 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050933 Jul 25 06:01:04.776206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 134/252] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:04.890475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f9299a60-f2bc-4286-8a3a-5fa1759118b0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "POST /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf/action" status: 200 len: 32 microversion: 2.1 time: 0.450596 Jul 25 06:01:04.891197 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 119/253] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:01:04 2022] POST /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf/action => generated 32 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:01:04.902003 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3da7c70b-a48d-4e5c-b56c-235892ac93a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:04.902872 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3da7c70b-a48d-4e5c-b56c-235892ac93a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:04.909561 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3da7c70b-a48d-4e5c-b56c-235892ac93a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:04.910226 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3da7c70b-a48d-4e5c-b56c-235892ac93a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:04.911188 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3da7c70b-a48d-4e5c-b56c-235892ac93a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:04.911639 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3da7c70b-a48d-4e5c-b56c-235892ac93a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:05.092454 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3da7c70b-a48d-4e5c-b56c-235892ac93a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:05.100501 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3da7c70b-a48d-4e5c-b56c-235892ac93a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.204012 Jul 25 06:01:05.101082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 135/254] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:04 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:05.146244 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6e8f5503-1702-4f0f-acdd-715cce966cb1 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:05.147488 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6e8f5503-1702-4f0f-acdd-715cce966cb1 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:05.154982 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e8f5503-1702-4f0f-acdd-715cce966cb1 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:05.155436 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e8f5503-1702-4f0f-acdd-715cce966cb1 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:05.156284 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e8f5503-1702-4f0f-acdd-715cce966cb1 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:05.156915 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e8f5503-1702-4f0f-acdd-715cce966cb1 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:05.401666 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6e8f5503-1702-4f0f-acdd-715cce966cb1 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:05.409629 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6e8f5503-1702-4f0f-acdd-715cce966cb1 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1318 microversion: 2.1 time: 0.267906 Jul 25 06:01:05.410299 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 120/255] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:05 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:06.119883 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-bfddce37-74c0-46c5-bd9d-e0e2d3f9f7f8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:06.120446 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-bfddce37-74c0-46c5-bd9d-e0e2d3f9f7f8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:06.126426 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bfddce37-74c0-46c5-bd9d-e0e2d3f9f7f8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.126866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bfddce37-74c0-46c5-bd9d-e0e2d3f9f7f8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.127610 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bfddce37-74c0-46c5-bd9d-e0e2d3f9f7f8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.128037 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bfddce37-74c0-46c5-bd9d-e0e2d3f9f7f8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.258445 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-bfddce37-74c0-46c5-bd9d-e0e2d3f9f7f8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:06.265951 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-bfddce37-74c0-46c5-bd9d-e0e2d3f9f7f8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.150753 Jul 25 06:01:06.266512 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 136/256] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:06 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:06.426682 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b76ceebe-0c40-4082-986b-fc583e84d5ba tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:06.427838 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b76ceebe-0c40-4082-986b-fc583e84d5ba tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:06.434110 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b76ceebe-0c40-4082-986b-fc583e84d5ba tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.434553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b76ceebe-0c40-4082-986b-fc583e84d5ba tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.436943 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b76ceebe-0c40-4082-986b-fc583e84d5ba tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:06.436943 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b76ceebe-0c40-4082-986b-fc583e84d5ba tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:06.570818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b76ceebe-0c40-4082-986b-fc583e84d5ba tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:06.578271 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b76ceebe-0c40-4082-986b-fc583e84d5ba tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1318 microversion: 2.1 time: 0.155581 Jul 25 06:01:06.578835 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 121/257] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:06 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:07.282760 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d5396138-f37e-4297-a039-9e36857cf96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:07.283294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d5396138-f37e-4297-a039-9e36857cf96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:07.289275 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d5396138-f37e-4297-a039-9e36857cf96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.289831 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d5396138-f37e-4297-a039-9e36857cf96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:07.290591 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d5396138-f37e-4297-a039-9e36857cf96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.291018 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d5396138-f37e-4297-a039-9e36857cf96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:07.418420 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d5396138-f37e-4297-a039-9e36857cf96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:07.425704 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d5396138-f37e-4297-a039-9e36857cf96a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.146926 Jul 25 06:01:07.426264 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 137/258] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:07 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:07.595430 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-046f82c7-0f1e-4f3e-94b8-d17f02ddb485 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:07.596037 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-046f82c7-0f1e-4f3e-94b8-d17f02ddb485 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:07.603769 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-046f82c7-0f1e-4f3e-94b8-d17f02ddb485 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.604246 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-046f82c7-0f1e-4f3e-94b8-d17f02ddb485 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:07.605019 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-046f82c7-0f1e-4f3e-94b8-d17f02ddb485 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:07.605449 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-046f82c7-0f1e-4f3e-94b8-d17f02ddb485 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:07.738624 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-046f82c7-0f1e-4f3e-94b8-d17f02ddb485 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:07.746907 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-046f82c7-0f1e-4f3e-94b8-d17f02ddb485 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1318 microversion: 2.1 time: 0.155357 Jul 25 06:01:07.747875 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 122/259] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:07 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:08.443973 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-10c9b654-ce7e-40ff-8b1e-80a922b1d055 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:08.444440 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-10c9b654-ce7e-40ff-8b1e-80a922b1d055 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:08.451172 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-10c9b654-ce7e-40ff-8b1e-80a922b1d055 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:08.451613 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-10c9b654-ce7e-40ff-8b1e-80a922b1d055 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:08.452388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-10c9b654-ce7e-40ff-8b1e-80a922b1d055 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:08.452824 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-10c9b654-ce7e-40ff-8b1e-80a922b1d055 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:08.592368 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-10c9b654-ce7e-40ff-8b1e-80a922b1d055 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:08.602244 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-10c9b654-ce7e-40ff-8b1e-80a922b1d055 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.163024 Jul 25 06:01:08.602955 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 138/260] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:08 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:08.763483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-29e9a1d5-3e30-4393-88a4-24425f11a7ee tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:08.764846 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-29e9a1d5-3e30-4393-88a4-24425f11a7ee tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:08.772329 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29e9a1d5-3e30-4393-88a4-24425f11a7ee tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:08.774796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29e9a1d5-3e30-4393-88a4-24425f11a7ee tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:08.774796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29e9a1d5-3e30-4393-88a4-24425f11a7ee tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:08.774796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29e9a1d5-3e30-4393-88a4-24425f11a7ee tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:08.903838 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-29e9a1d5-3e30-4393-88a4-24425f11a7ee tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:08.911163 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-29e9a1d5-3e30-4393-88a4-24425f11a7ee tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1318 microversion: 2.1 time: 0.151563 Jul 25 06:01:08.912098 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 123/261] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:08 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:09.625000 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-20db9864-6271-41df-b272-e242c277c29a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:09.625000 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-20db9864-6271-41df-b272-e242c277c29a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:09.626837 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-20db9864-6271-41df-b272-e242c277c29a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:09.627289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-20db9864-6271-41df-b272-e242c277c29a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:09.628052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-20db9864-6271-41df-b272-e242c277c29a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:09.628506 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-20db9864-6271-41df-b272-e242c277c29a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:09.798574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-20db9864-6271-41df-b272-e242c277c29a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:09.806590 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-20db9864-6271-41df-b272-e242c277c29a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.191263 Jul 25 06:01:09.807166 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 139/262] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:09 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:09.928046 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1c5af4e5-e5b6-4fcd-9dbc-82e2a5c3f1bf tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:09.928861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1c5af4e5-e5b6-4fcd-9dbc-82e2a5c3f1bf tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:09.935739 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1c5af4e5-e5b6-4fcd-9dbc-82e2a5c3f1bf tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:09.936204 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1c5af4e5-e5b6-4fcd-9dbc-82e2a5c3f1bf tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:09.936965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1c5af4e5-e5b6-4fcd-9dbc-82e2a5c3f1bf tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:09.937395 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1c5af4e5-e5b6-4fcd-9dbc-82e2a5c3f1bf tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:10.075026 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1c5af4e5-e5b6-4fcd-9dbc-82e2a5c3f1bf tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:10.083364 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1c5af4e5-e5b6-4fcd-9dbc-82e2a5c3f1bf tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1318 microversion: 2.1 time: 0.158990 Jul 25 06:01:10.093992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 124/263] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:09 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:10.825620 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-fef99aca-c03a-43c8-8a9b-bac42aff32f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:10.860319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-fef99aca-c03a-43c8-8a9b-bac42aff32f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:10.860319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:10.860319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=6 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:10.860319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fef99aca-c03a-43c8-8a9b-bac42aff32f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:10.860319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fef99aca-c03a-43c8-8a9b-bac42aff32f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:10.860816 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fef99aca-c03a-43c8-8a9b-bac42aff32f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:10.860816 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fef99aca-c03a-43c8-8a9b-bac42aff32f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:10.979660 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-fef99aca-c03a-43c8-8a9b-bac42aff32f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:10.987235 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-fef99aca-c03a-43c8-8a9b-bac42aff32f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.167490 Jul 25 06:01:10.987796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 140/264] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:10 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:11.100867 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-40ef7a49-0cbb-49c0-b56e-f8c179d7f8b2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:11.101472 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-40ef7a49-0cbb-49c0-b56e-f8c179d7f8b2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:11.103587 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:11.108997 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-40ef7a49-0cbb-49c0-b56e-f8c179d7f8b2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:11.109434 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-40ef7a49-0cbb-49c0-b56e-f8c179d7f8b2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:11.110180 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-40ef7a49-0cbb-49c0-b56e-f8c179d7f8b2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:11.110606 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-40ef7a49-0cbb-49c0-b56e-f8c179d7f8b2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:11.382251 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-40ef7a49-0cbb-49c0-b56e-f8c179d7f8b2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:11.389746 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-40ef7a49-0cbb-49c0-b56e-f8c179d7f8b2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1318 microversion: 2.1 time: 0.292622 Jul 25 06:01:11.390322 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 125/265] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:11 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:11.658446 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-9e151245-d3be-48b0-b05b-95b09d66b86c req-eaca300a-fdb0-47f9-90bb-aaeaf70f3695 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "2abbf803-6310-4fcd-bc09-ff506fab0a30", "name": "network-vif-plugged", "status": "completed", "tag": "c773c2c6-02cb-4486-8cdb-0116d19cfa92"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:11.669603 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-9e151245-d3be-48b0-b05b-95b09d66b86c req-eaca300a-fdb0-47f9-90bb-aaeaf70f3695 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:11.670068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-9e151245-d3be-48b0-b05b-95b09d66b86c req-eaca300a-fdb0-47f9-90bb-aaeaf70f3695 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:11.682081 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-9e151245-d3be-48b0-b05b-95b09d66b86c req-eaca300a-fdb0-47f9-90bb-aaeaf70f3695 service nova] Creating event network-vif-plugged:c773c2c6-02cb-4486-8cdb-0116d19cfa92 for instance 2abbf803-6310-4fcd-bc09-ff506fab0a30 on hv-cinder-84841 Jul 25 06:01:11.687360 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-9e151245-d3be-48b0-b05b-95b09d66b86c req-eaca300a-fdb0-47f9-90bb-aaeaf70f3695 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033261 Jul 25 06:01:11.688397 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 141/266] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:12.004960 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-af79bb2a-7bee-4c08-9573-89663b08362b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:12.005575 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-af79bb2a-7bee-4c08-9573-89663b08362b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:12.020089 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af79bb2a-7bee-4c08-9573-89663b08362b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:12.021376 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af79bb2a-7bee-4c08-9573-89663b08362b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:12.021376 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af79bb2a-7bee-4c08-9573-89663b08362b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:12.021751 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af79bb2a-7bee-4c08-9573-89663b08362b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:12.163622 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-af79bb2a-7bee-4c08-9573-89663b08362b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:12.171444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-af79bb2a-7bee-4c08-9573-89663b08362b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.170511 Jul 25 06:01:12.174652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 126/267] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:11 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:12.407524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5ba6f63d-c8ad-4006-9e74-35a43d76c3f0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:12.408253 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5ba6f63d-c8ad-4006-9e74-35a43d76c3f0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:12.414794 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ba6f63d-c8ad-4006-9e74-35a43d76c3f0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:12.415201 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ba6f63d-c8ad-4006-9e74-35a43d76c3f0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:12.416037 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ba6f63d-c8ad-4006-9e74-35a43d76c3f0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:12.416503 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ba6f63d-c8ad-4006-9e74-35a43d76c3f0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:12.589147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5ba6f63d-c8ad-4006-9e74-35a43d76c3f0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:12.596367 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5ba6f63d-c8ad-4006-9e74-35a43d76c3f0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1318 microversion: 2.1 time: 0.193207 Jul 25 06:01:12.596922 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 142/268] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:12 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:13.188855 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-199e05b2-e53f-45d1-92be-bea5feedae9c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:13.189458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-199e05b2-e53f-45d1-92be-bea5feedae9c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:13.196283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-199e05b2-e53f-45d1-92be-bea5feedae9c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:13.196787 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-199e05b2-e53f-45d1-92be-bea5feedae9c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:13.197539 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-199e05b2-e53f-45d1-92be-bea5feedae9c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:13.197966 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-199e05b2-e53f-45d1-92be-bea5feedae9c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:13.326878 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-199e05b2-e53f-45d1-92be-bea5feedae9c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:13.335672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-199e05b2-e53f-45d1-92be-bea5feedae9c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.150890 Jul 25 06:01:13.337141 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 127/269] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:13 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:13.612745 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-dcf0050e-790c-4a37-843b-a7955d02be5d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:13.613433 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-dcf0050e-790c-4a37-843b-a7955d02be5d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:13.619790 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dcf0050e-790c-4a37-843b-a7955d02be5d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:13.620346 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dcf0050e-790c-4a37-843b-a7955d02be5d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:13.621624 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dcf0050e-790c-4a37-843b-a7955d02be5d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:13.621624 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dcf0050e-790c-4a37-843b-a7955d02be5d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:13.770526 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-dcf0050e-790c-4a37-843b-a7955d02be5d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:13.780135 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-dcf0050e-790c-4a37-843b-a7955d02be5d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1318 microversion: 2.1 time: 0.171486 Jul 25 06:01:13.780723 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 143/270] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:13 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:14.354161 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c45ff56c-fa2d-4b30-befc-4eef1964ae47 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:14.354778 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c45ff56c-fa2d-4b30-befc-4eef1964ae47 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:14.361260 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c45ff56c-fa2d-4b30-befc-4eef1964ae47 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.361708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c45ff56c-fa2d-4b30-befc-4eef1964ae47 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.362474 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c45ff56c-fa2d-4b30-befc-4eef1964ae47 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.362904 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c45ff56c-fa2d-4b30-befc-4eef1964ae47 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.529263 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c45ff56c-fa2d-4b30-befc-4eef1964ae47 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:14.542123 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c45ff56c-fa2d-4b30-befc-4eef1964ae47 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.192773 Jul 25 06:01:14.543556 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 128/271] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:14 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:14.797214 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-776d4ac5-18b9-436e-8575-5ae2f61ee478 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:14.797723 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-776d4ac5-18b9-436e-8575-5ae2f61ee478 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:14.804022 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-776d4ac5-18b9-436e-8575-5ae2f61ee478 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.804617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-776d4ac5-18b9-436e-8575-5ae2f61ee478 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.806741 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-776d4ac5-18b9-436e-8575-5ae2f61ee478 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:14.807117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-776d4ac5-18b9-436e-8575-5ae2f61ee478 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:14.944785 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-776d4ac5-18b9-436e-8575-5ae2f61ee478 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:14.953141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-776d4ac5-18b9-436e-8575-5ae2f61ee478 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1318 microversion: 2.1 time: 0.159871 Jul 25 06:01:14.953744 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 144/272] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:14 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:15.560658 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-cec2a46f-a571-42a5-bda3-90ff9fe7f0ed tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:15.561314 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-cec2a46f-a571-42a5-bda3-90ff9fe7f0ed tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:15.567776 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cec2a46f-a571-42a5-bda3-90ff9fe7f0ed tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:15.568259 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cec2a46f-a571-42a5-bda3-90ff9fe7f0ed tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:15.569021 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cec2a46f-a571-42a5-bda3-90ff9fe7f0ed tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:15.569459 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cec2a46f-a571-42a5-bda3-90ff9fe7f0ed tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:15.703842 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cec2a46f-a571-42a5-bda3-90ff9fe7f0ed tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:15.712604 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-cec2a46f-a571-42a5-bda3-90ff9fe7f0ed tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.155779 Jul 25 06:01:15.713175 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 129/273] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:15 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:15.969934 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-884d29a4-ee6b-46d4-ae0e-c816a84ac726 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:15.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-884d29a4-ee6b-46d4-ae0e-c816a84ac726 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:15.976712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-884d29a4-ee6b-46d4-ae0e-c816a84ac726 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:15.987906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-884d29a4-ee6b-46d4-ae0e-c816a84ac726 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:15.987906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-884d29a4-ee6b-46d4-ae0e-c816a84ac726 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:15.987906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-884d29a4-ee6b-46d4-ae0e-c816a84ac726 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:16.132252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-884d29a4-ee6b-46d4-ae0e-c816a84ac726 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:16.141576 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-884d29a4-ee6b-46d4-ae0e-c816a84ac726 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1318 microversion: 2.1 time: 0.175537 Jul 25 06:01:16.142247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 145/274] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:15 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:16.731193 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c8f5ca80-ffe4-4958-8b19-0f10d7467418 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:16.732396 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c8f5ca80-ffe4-4958-8b19-0f10d7467418 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:16.739751 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c8f5ca80-ffe4-4958-8b19-0f10d7467418 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:16.740224 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c8f5ca80-ffe4-4958-8b19-0f10d7467418 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:16.741567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c8f5ca80-ffe4-4958-8b19-0f10d7467418 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:16.742061 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c8f5ca80-ffe4-4958-8b19-0f10d7467418 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:16.878461 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c8f5ca80-ffe4-4958-8b19-0f10d7467418 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:16.883871 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c8f5ca80-ffe4-4958-8b19-0f10d7467418 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.157863 Jul 25 06:01:16.884504 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 130/275] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:16 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:17.158931 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-42e4af42-1e5b-4555-89dc-15e1cda370ea tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:17.160226 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-42e4af42-1e5b-4555-89dc-15e1cda370ea tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:17.166911 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42e4af42-1e5b-4555-89dc-15e1cda370ea tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.167361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42e4af42-1e5b-4555-89dc-15e1cda370ea tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:17.168138 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42e4af42-1e5b-4555-89dc-15e1cda370ea tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.168571 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42e4af42-1e5b-4555-89dc-15e1cda370ea tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:17.301756 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-42e4af42-1e5b-4555-89dc-15e1cda370ea tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:17.309486 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-42e4af42-1e5b-4555-89dc-15e1cda370ea tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1506 microversion: 2.1 time: 0.154622 Jul 25 06:01:17.310061 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 146/276] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:17 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:17.901892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a4c0ff16-b8fa-4eb4-b6dc-7e6ec33263c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:17.903499 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a4c0ff16-b8fa-4eb4-b6dc-7e6ec33263c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:17.913242 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff16-b8fa-4eb4-b6dc-7e6ec33263c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.913694 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff16-b8fa-4eb4-b6dc-7e6ec33263c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:17.915246 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff16-b8fa-4eb4-b6dc-7e6ec33263c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:17.915689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a4c0ff16-b8fa-4eb4-b6dc-7e6ec33263c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:18.056133 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a4c0ff16-b8fa-4eb4-b6dc-7e6ec33263c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:18.064835 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a4c0ff16-b8fa-4eb4-b6dc-7e6ec33263c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.167702 Jul 25 06:01:18.065410 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 131/277] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:17 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:19.082661 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e9beaf96-4a05-4149-9008-544c77778888 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:19.083197 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e9beaf96-4a05-4149-9008-544c77778888 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:19.090839 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e9beaf96-4a05-4149-9008-544c77778888 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:19.091291 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e9beaf96-4a05-4149-9008-544c77778888 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:19.092054 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e9beaf96-4a05-4149-9008-544c77778888 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:19.092520 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e9beaf96-4a05-4149-9008-544c77778888 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:19.234926 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e9beaf96-4a05-4149-9008-544c77778888 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:19.243222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e9beaf96-4a05-4149-9008-544c77778888 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.164180 Jul 25 06:01:19.244287 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 147/278] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:19 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:20.261314 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-84246f11-51a1-46c2-b8d7-d5ed48a5ac79 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:20.261932 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-84246f11-51a1-46c2-b8d7-d5ed48a5ac79 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:20.268614 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84246f11-51a1-46c2-b8d7-d5ed48a5ac79 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.271015 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84246f11-51a1-46c2-b8d7-d5ed48a5ac79 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.271015 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84246f11-51a1-46c2-b8d7-d5ed48a5ac79 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.271015 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84246f11-51a1-46c2-b8d7-d5ed48a5ac79 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.413261 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-84246f11-51a1-46c2-b8d7-d5ed48a5ac79 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:20.414129 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:20.418802 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-84246f11-51a1-46c2-b8d7-d5ed48a5ac79 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1501 microversion: 2.1 time: 0.162696 Jul 25 06:01:20.419373 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 132/279] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:20 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:20.435542 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3eab9449-c84e-4888-a6e9-da3c4227f1f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f1c0>>, body: {"volumeAttachment": {"volumeId": "cce3ac76-80da-4a29-b62c-90fd9d5a52fc"}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:20.437094 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3eab9449-c84e-4888-a6e9-da3c4227f1f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:20.446487 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3eab9449-c84e-4888-a6e9-da3c4227f1f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.447010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3eab9449-c84e-4888-a6e9-da3c4227f1f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.447787 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3eab9449-c84e-4888-a6e9-da3c4227f1f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.448246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3eab9449-c84e-4888-a6e9-da3c4227f1f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.472194 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-3eab9449-c84e-4888-a6e9-da3c4227f1f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] HTTP exception thrown: Cannot 'attach_volume' instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf while it is in vm_state rescued Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3eab9449-c84e-4888-a6e9-da3c4227f1f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Request method failure captured: Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: POST /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf/os-volume_attachments HTTP/1.1 Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 74 Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFNLWQeCYHz8Io1IOt6Hr-lMqJ9K-YweQE3M09yh5R7VR6PG1vMjGfytjWdlaoZHzEo1B_oyLz7Zah8DrhHF8tlpaMtpzBWgxpFZSG7xixeUC3XpV_tpocgpoF3BlRnF2cUrT4CpeLoCBBUGjv0RwbBYMNZ8LqFjtnv-2kVRjdbEIg Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 07562543fa3e40d584b4d4525b112319 Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:01:20.473817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/07562543fa3e40d584b4d4525b112319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07562543fa3e40d584b4d4525b112319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_07562543fa3e40d584b4d4525b112319", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07562543fa3e40d584b4d4525b112319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 07562543fa3e40d584b4d4525b112319 Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-ServerRescueNegativeTestJSON-1718876686-project Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 62e566aa74b045cb8cc6e8edf4a256e1 Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718876686-project Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {"volumeAttachment": {"volumeId": "cce3ac76-80da-4a29-b62c-90fd9d5a52fc"}} Jul 25 06:01:20.475285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f1c0>> Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Cannot 'attach_volume' instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf while it is in vm_state rescued Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'server_id': '3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf', 'body': {'volumeAttachment': {'volumeId': 'cce3ac76-80da-4a29-b62c-90fd9d5a52fc'}}} Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:01:20.476141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf while it is in vm_state rescued Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:01:20.477491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:01:20.478860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:01:20.478860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:01:20.478860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf while it is in vm_state rescued Jul 25 06:01:20.478860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:01:20.478860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3eab9449-c84e-4888-a6e9-da3c4227f1f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Returning 409 to user: Cannot 'attach_volume' instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf while it is in vm_state rescued {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:01:20.478860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3eab9449-c84e-4888-a6e9-da3c4227f1f6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "POST /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043741 Jul 25 06:01:20.478860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 148/280] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:01:20 2022] POST /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 06:01:20.485165 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1f4caf7d-a4e7-4b54-8ba2-2c039acf642e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Action: 'action', calling method: <bound method RescueController._unrescue of <nova.api.openstack.compute.rescue.RescueController object at 0x7f6533ed8e50>>, body: {"unrescue": {}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:20.485707 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1f4caf7d-a4e7-4b54-8ba2-2c039acf642e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:20.495336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f4caf7d-a4e7-4b54-8ba2-2c039acf642e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.495336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f4caf7d-a4e7-4b54-8ba2-2c039acf642e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.495336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f4caf7d-a4e7-4b54-8ba2-2c039acf642e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.495336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f4caf7d-a4e7-4b54-8ba2-2c039acf642e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.711305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1f4caf7d-a4e7-4b54-8ba2-2c039acf642e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "POST /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf/action" status: 202 len: 0 microversion: 2.1 time: 0.230016 Jul 25 06:01:20.712062 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 133/281] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:01:20 2022] POST /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:01:20.720298 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3d2feaf6-5f85-4e5e-a473-20e899d78559 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:20.720902 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3d2feaf6-5f85-4e5e-a473-20e899d78559 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:20.728327 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3d2feaf6-5f85-4e5e-a473-20e899d78559 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.728774 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3d2feaf6-5f85-4e5e-a473-20e899d78559 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.729572 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3d2feaf6-5f85-4e5e-a473-20e899d78559 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:20.730164 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3d2feaf6-5f85-4e5e-a473-20e899d78559 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:20.735010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:20.869500 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3d2feaf6-5f85-4e5e-a473-20e899d78559 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:20.877509 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3d2feaf6-5f85-4e5e-a473-20e899d78559 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1509 microversion: 2.1 time: 0.161019 Jul 25 06:01:20.878295 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 149/282] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:20 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:21.897391 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-82714b1e-cfcb-4b8a-9cc9-2c23797c0885 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:21.898190 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-82714b1e-cfcb-4b8a-9cc9-2c23797c0885 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:21.900919 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=48 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:21.906069 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-82714b1e-cfcb-4b8a-9cc9-2c23797c0885 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:21.906521 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-82714b1e-cfcb-4b8a-9cc9-2c23797c0885 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:21.907282 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-82714b1e-cfcb-4b8a-9cc9-2c23797c0885 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:21.907713 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-82714b1e-cfcb-4b8a-9cc9-2c23797c0885 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:22.045827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-82714b1e-cfcb-4b8a-9cc9-2c23797c0885 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:22.053303 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-82714b1e-cfcb-4b8a-9cc9-2c23797c0885 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1509 microversion: 2.1 time: 0.161178 Jul 25 06:01:22.053864 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 134/283] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:21 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:23.072423 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-450f838c-8251-4700-a66f-9439196a079b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:23.073644 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-450f838c-8251-4700-a66f-9439196a079b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:23.080706 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-450f838c-8251-4700-a66f-9439196a079b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:23.081169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-450f838c-8251-4700-a66f-9439196a079b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:23.081894 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-450f838c-8251-4700-a66f-9439196a079b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:23.082324 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-450f838c-8251-4700-a66f-9439196a079b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:23.217520 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-450f838c-8251-4700-a66f-9439196a079b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:23.234262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-450f838c-8251-4700-a66f-9439196a079b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1509 microversion: 2.1 time: 0.165968 Jul 25 06:01:23.234846 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 150/284] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:23 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:24.250939 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-99386962-2fd3-48c1-b248-c4fc99b3b51a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:24.251548 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-99386962-2fd3-48c1-b248-c4fc99b3b51a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:24.258198 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-99386962-2fd3-48c1-b248-c4fc99b3b51a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:24.258645 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-99386962-2fd3-48c1-b248-c4fc99b3b51a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:24.259400 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-99386962-2fd3-48c1-b248-c4fc99b3b51a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:24.259834 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-99386962-2fd3-48c1-b248-c4fc99b3b51a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:24.455713 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-99386962-2fd3-48c1-b248-c4fc99b3b51a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:24.463433 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-99386962-2fd3-48c1-b248-c4fc99b3b51a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1509 microversion: 2.1 time: 0.216336 Jul 25 06:01:24.464741 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 135/285] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:24 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:24.732468 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d0b8f17c-e8e9-49eb-b9a1-714a7b090d65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method IPsController.index of <nova.api.openstack.compute.ips.IPsController object at 0x7f6533eed040>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:24.733073 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d0b8f17c-e8e9-49eb-b9a1-714a7b090d65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:24.740323 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0b8f17c-e8e9-49eb-b9a1-714a7b090d65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:24.740951 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0b8f17c-e8e9-49eb-b9a1-714a7b090d65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:24.742012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0b8f17c-e8e9-49eb-b9a1-714a7b090d65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:24.742630 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0b8f17c-e8e9-49eb-b9a1-714a7b090d65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:24.770368 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d0b8f17c-e8e9-49eb-b9a1-714a7b090d65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/ips" status: 200 len: 149 microversion: 2.1 time: 0.042819 Jul 25 06:01:24.771569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 151/286] 10.222.0.40 () {58 vars in 1247 bytes} [Mon Jul 25 06:01:24 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:24.817541 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-714348fa-358a-40ca-8fd2-fc44c1e4b793 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method IPsController.index of <nova.api.openstack.compute.ips.IPsController object at 0x7f6533ee6fa0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:24.818127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-714348fa-358a-40ca-8fd2-fc44c1e4b793 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:24.824854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-714348fa-358a-40ca-8fd2-fc44c1e4b793 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:24.825295 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-714348fa-358a-40ca-8fd2-fc44c1e4b793 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:24.826054 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-714348fa-358a-40ca-8fd2-fc44c1e4b793 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:24.826481 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-714348fa-358a-40ca-8fd2-fc44c1e4b793 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:24.856996 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-714348fa-358a-40ca-8fd2-fc44c1e4b793 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/ips" status: 200 len: 147 microversion: 2.1 time: 0.043378 Jul 25 06:01:24.857897 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 136/287] 10.222.0.40 () {58 vars in 1247 bytes} [Mon Jul 25 06:01:24 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/ips => generated 147 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:25.482512 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2ff25607-bdc2-4999-a5e5-916144e1ea5b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:25.483130 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2ff25607-bdc2-4999-a5e5-916144e1ea5b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:25.494004 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2ff25607-bdc2-4999-a5e5-916144e1ea5b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:25.497987 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2ff25607-bdc2-4999-a5e5-916144e1ea5b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:25.497987 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2ff25607-bdc2-4999-a5e5-916144e1ea5b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:25.497987 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2ff25607-bdc2-4999-a5e5-916144e1ea5b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:25.642906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2ff25607-bdc2-4999-a5e5-916144e1ea5b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:25.650609 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2ff25607-bdc2-4999-a5e5-916144e1ea5b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1515 microversion: 2.1 time: 0.172382 Jul 25 06:01:25.651730 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 152/288] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:25 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:26.463368 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-095b0cb0-e613-41cf-8107-b1f0a09e25aa tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f190>>, body: {"volumeAttachment": {"volumeId": "e5b9fbc3-bd4e-4941-bb6f-b015f283d330"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:26.465031 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-095b0cb0-e613-41cf-8107-b1f0a09e25aa tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:26.472360 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-095b0cb0-e613-41cf-8107-b1f0a09e25aa tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:26.472940 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-095b0cb0-e613-41cf-8107-b1f0a09e25aa tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:26.473757 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-095b0cb0-e613-41cf-8107-b1f0a09e25aa tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:26.474362 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-095b0cb0-e613-41cf-8107-b1f0a09e25aa tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:27.314007 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-252957bb-2b6d-462f-acf5-72ee3bd2bb9f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f65326dd430>, body: {"keypair": {"name": "tempest-keypair-918391429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA57qoMB+NlUWxwGqg5cNODCPWMf8WrzEARdjURdZimRzjcPr2O90MbzC1uzK9gcCRj+bvzrxlHpQp5ZgiBEB6fZ7PXHomHWRhwaHxifQRFtkVP/tw2l1z/9axiIn0yTag=="}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:27.324951 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:27.337376 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-095b0cb0-e613-41cf-8107-b1f0a09e25aa tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867466 Jul 25 06:01:27.337376 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 137/289] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:01:26 2022] POST /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments => generated 194 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:27.337569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-252957bb-2b6d-462f-acf5-72ee3bd2bb9f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Getting quotas for project 07562543fa3e40d584b4d4525b112319. Resources: {'key_pairs'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:01:27.338431 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-252957bb-2b6d-462f-acf5-72ee3bd2bb9f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Getting quotas for user 62e566aa74b045cb8cc6e8edf4a256e1 and project 07562543fa3e40d584b4d4525b112319. Resources: {'key_pairs'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:01:27.469252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-252957bb-2b6d-462f-acf5-72ee3bd2bb9f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159157 Jul 25 06:01:27.472842 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 153/290] 10.222.0.40 () {60 vars in 1158 bytes} [Mon Jul 25 06:01:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:28.163819 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2fceebaf-a599-4fce-85af-139a08715004 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f190>>, body: {"volumeAttachment": {"volumeId": "2c538353-f5e8-476e-bc88-5207277140f4"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:28.165296 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2fceebaf-a599-4fce-85af-139a08715004 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:28.185226 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2fceebaf-a599-4fce-85af-139a08715004 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:28.185726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2fceebaf-a599-4fce-85af-139a08715004 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:28.186516 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2fceebaf-a599-4fce-85af-139a08715004 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:28.187096 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2fceebaf-a599-4fce-85af-139a08715004 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:28.976624 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5d7b64be-449c-4af8-9e25-ff8b15c0d8e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method IPsController.index of <nova.api.openstack.compute.ips.IPsController object at 0x7f6533eed040>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:28.977191 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5d7b64be-449c-4af8-9e25-ff8b15c0d8e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:28.984242 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5d7b64be-449c-4af8-9e25-ff8b15c0d8e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:28.984681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5d7b64be-449c-4af8-9e25-ff8b15c0d8e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:28.985425 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5d7b64be-449c-4af8-9e25-ff8b15c0d8e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:28.985862 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5d7b64be-449c-4af8-9e25-ff8b15c0d8e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:29.016243 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5d7b64be-449c-4af8-9e25-ff8b15c0d8e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/ips" status: 200 len: 150 microversion: 2.20 time: 0.043948 Jul 25 06:01:29.023999 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 154/291] 10.222.0.40 () {60 vars in 1288 bytes} [Mon Jul 25 06:01:28 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 06:01:29.348373 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2fceebaf-a599-4fce-85af-139a08715004 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "POST /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.202319 Jul 25 06:01:29.352247 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 138/292] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:01:28 2022] POST /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/os-volume_attachments => generated 194 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:30.431074 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-150045722", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa79d0fe-56b1-4e97-990f-ad8f32170783"}], "security_groups": [{"name": "tempest-securitygroup--1600786992"}], "key_name": "tempest-keypair-918391429", "user_data": "}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:32.396452 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fd57d515-7efa-42eb-8e25-70254cf0e9ca tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Action: 'action', calling method: <bound method ShelveController._shelve of <nova.api.openstack.compute.shelve.ShelveController object at 0x7f6533edda60>>, body: {"shelve": {}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:32.397098 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-fd57d515-7efa-42eb-8e25-70254cf0e9ca tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:32.403971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd57d515-7efa-42eb-8e25-70254cf0e9ca tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:32.404444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd57d515-7efa-42eb-8e25-70254cf0e9ca tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:32.405199 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd57d515-7efa-42eb-8e25-70254cf0e9ca tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:32.405624 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd57d515-7efa-42eb-8e25-70254cf0e9ca tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:32.427865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-fd57d515-7efa-42eb-8e25-70254cf0e9ca tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lazy-loading 'flavor' on Instance uuid b2dc5c54-08fc-4392-a4b9-f1970578ffb7 {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:01:36.955001 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] validate_networks() for [('aa79d0fe-56b1-4e97-990f-ad8f32170783', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:01:37.236901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-fd57d515-7efa-42eb-8e25-70254cf0e9ca tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "POST /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/action" status: 202 len: 0 microversion: 2.20 time: 4.844798 Jul 25 06:01:37.239606 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 139/293] 10.222.0.40 () {62 vars in 1318 bytes} [Mon Jul 25 06:01:32 2022] POST /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/action => generated 0 bytes in 4848 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 06:01:37.247459 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-00e8c2dd-3008-4146-a36b-a45b59866547 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6531f189d0>, body: {"keypair": {"name": "tempest-keypair-1771989104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvVKgrA3QRwUTT+7d7qcWbf7rsmwV39Ucw8kzzwycvKzwNdUlr3vv+D9vWb2sKmi3nrOHk0iTqGWVQNnACwSO5h0/1KHOfWDaxQv6EhU21a2lZblPB1ePe6gAN7Xm44Sg=="}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:37.267480 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-00e8c2dd-3008-4146-a36b-a45b59866547 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:01:37.272282 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-00e8c2dd-3008-4146-a36b-a45b59866547 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for user 8eedefd8d94047478663ceab8962d738 and project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:01:37.353709 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=4 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:37.396402 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-00e8c2dd-3008-4146-a36b-a45b59866547 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154732 Jul 25 06:01:37.397231 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 140/294] 10.222.0.40 () {60 vars in 1158 bytes} [Mon Jul 25 06:01:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:37.402934 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-15c5567a-ba97-4aae-8e7a-8e045e9be9e8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:37.412971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-15c5567a-ba97-4aae-8e7a-8e045e9be9e8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:37.427542 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-15c5567a-ba97-4aae-8e7a-8e045e9be9e8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.427995 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-15c5567a-ba97-4aae-8e7a-8e045e9be9e8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.428794 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-15c5567a-ba97-4aae-8e7a-8e045e9be9e8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.429233 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-15c5567a-ba97-4aae-8e7a-8e045e9be9e8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.482100 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:01:37.482523 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:01:37.483029 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:01:37.483422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:01:37.484010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:01:37.498026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.498551 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.499415 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:37.499853 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:37.520408 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Getting quotas for project 07562543fa3e40d584b4d4525b112319. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:01:37.525100 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Getting quotas for user 62e566aa74b045cb8cc6e8edf4a256e1 and project 07562543fa3e40d584b4d4525b112319. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:01:37.541174 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:01:37.543767 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:01:37.622820 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-15c5567a-ba97-4aae-8e7a-8e045e9be9e8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:37.631141 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-15c5567a-ba97-4aae-8e7a-8e045e9be9e8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:37.632925 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-15c5567a-ba97-4aae-8e7a-8e045e9be9e8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:37.634300 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-15c5567a-ba97-4aae-8e7a-8e045e9be9e8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.236022 Jul 25 06:01:37.634874 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 141/295] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:37 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:37.686721 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-05af4c09-64ee-4263-aae6-548f12cbb6bd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 7.259887 Jul 25 06:01:37.687698 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 155/296] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:01:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 7261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:01:37.697501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a1c9c462-b0b8-4fca-9f72-affdb2fcff1c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:37.698117 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a1c9c462-b0b8-4fca-9f72-affdb2fcff1c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:37.775679 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a1c9c462-b0b8-4fca-9f72-affdb2fcff1c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:37.794235 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a1c9c462-b0b8-4fca-9f72-affdb2fcff1c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1244 microversion: 2.1 time: 0.098578 Jul 25 06:01:37.806190 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 142/297] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:37 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1244 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:38.655232 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-766c52aa-5893-422d-b960-de2cb4b77534 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:38.655847 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-766c52aa-5893-422d-b960-de2cb4b77534 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:38.662002 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-766c52aa-5893-422d-b960-de2cb4b77534 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:38.662454 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-766c52aa-5893-422d-b960-de2cb4b77534 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:38.663214 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-766c52aa-5893-422d-b960-de2cb4b77534 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:38.663652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-766c52aa-5893-422d-b960-de2cb4b77534 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:38.813339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-cd3ff645-7807-4e0e-8a9a-01b56a0a38c4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:38.814164 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-cd3ff645-7807-4e0e-8a9a-01b56a0a38c4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:38.822123 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cd3ff645-7807-4e0e-8a9a-01b56a0a38c4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:38.822587 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cd3ff645-7807-4e0e-8a9a-01b56a0a38c4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:38.823369 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cd3ff645-7807-4e0e-8a9a-01b56a0a38c4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:38.823808 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cd3ff645-7807-4e0e-8a9a-01b56a0a38c4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:38.861973 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-766c52aa-5893-422d-b960-de2cb4b77534 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:38.871703 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-766c52aa-5893-422d-b960-de2cb4b77534 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:38.873796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-766c52aa-5893-422d-b960-de2cb4b77534 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:38.875375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-766c52aa-5893-422d-b960-de2cb4b77534 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.224210 Jul 25 06:01:38.875991 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 156/298] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:38 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:38.888891 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cd3ff645-7807-4e0e-8a9a-01b56a0a38c4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:38.897132 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-cd3ff645-7807-4e0e-8a9a-01b56a0a38c4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1248 microversion: 2.1 time: 0.087558 Jul 25 06:01:38.897901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 143/299] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:38 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1248 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:39.894341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4026b045-0cff-4a56-8d3f-950322fcba11 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:39.895196 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4026b045-0cff-4a56-8d3f-950322fcba11 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:39.901542 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4026b045-0cff-4a56-8d3f-950322fcba11 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:39.902118 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4026b045-0cff-4a56-8d3f-950322fcba11 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:39.903477 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4026b045-0cff-4a56-8d3f-950322fcba11 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:39.903909 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4026b045-0cff-4a56-8d3f-950322fcba11 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:39.916830 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1ffa809e-f43a-460c-8b1d-d506a65c21a0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:39.918854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1ffa809e-f43a-460c-8b1d-d506a65c21a0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:39.929392 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1ffa809e-f43a-460c-8b1d-d506a65c21a0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:39.930185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1ffa809e-f43a-460c-8b1d-d506a65c21a0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:39.931300 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1ffa809e-f43a-460c-8b1d-d506a65c21a0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:39.931811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1ffa809e-f43a-460c-8b1d-d506a65c21a0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:40.022437 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1ffa809e-f43a-460c-8b1d-d506a65c21a0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:40.030148 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1ffa809e-f43a-460c-8b1d-d506a65c21a0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1296 microversion: 2.1 time: 0.117520 Jul 25 06:01:40.030652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 144/300] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:39 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1296 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:40.035567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5c4c0>>, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1978446162", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d80cb7ca-3031-41c9-afe8-b6a4faf27141"}], "security_groups": [{"name": "tempest-securitygroup--309417210"}], "key_name": "tempest-keypair-1771989104", "user_data": "}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:40.065349 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4026b045-0cff-4a56-8d3f-950322fcba11 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:40.073600 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4026b045-0cff-4a56-8d3f-950322fcba11 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:40.075868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4026b045-0cff-4a56-8d3f-950322fcba11 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:40.077047 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4026b045-0cff-4a56-8d3f-950322fcba11 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.186727 Jul 25 06:01:40.077592 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 157/301] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:39 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:40.137907 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.network.neutron [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] validate_networks() for [('d80cb7ca-3031-41c9-afe8-b6a4faf27141', None, None, None, None, None)] {{(pid=124918) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:01:40.740776 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Flavor limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:01:40.741468 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Image limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:01:40.742077 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Flavor pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:01:40.742583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Image pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:01:40.743119 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:01:40.753226 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:40.753728 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:40.754516 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:40.754943 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:40.772516 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:01:40.776823 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for user 8eedefd8d94047478663ceab8962d738 and project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:01:40.789312 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Going to run 1 instances... {{(pid=124918) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:01:40.791566 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:01:40.905448 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1937cbde-c920-4737-95f5-558c07f6a87c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.873437 Jul 25 06:01:40.906003 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 145/302] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:01:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:01:40.917299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4db720fd-3ee8-410b-95f3-d0948060c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:40.919216 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4db720fd-3ee8-410b-95f3-d0948060c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:41.006963 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4db720fd-3ee8-410b-95f3-d0948060c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:41.016810 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4db720fd-3ee8-410b-95f3-d0948060c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1242 microversion: 2.1 time: 0.104513 Jul 25 06:01:41.019655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 158/303] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:40 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:41.049836 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6b50f59a-6efd-4176-ad8c-c9b769b6e5c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:41.051013 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6b50f59a-6efd-4176-ad8c-c9b769b6e5c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:41.060638 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b50f59a-6efd-4176-ad8c-c9b769b6e5c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.061359 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b50f59a-6efd-4176-ad8c-c9b769b6e5c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:41.062387 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b50f59a-6efd-4176-ad8c-c9b769b6e5c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.063015 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b50f59a-6efd-4176-ad8c-c9b769b6e5c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:41.096068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0c12fc1c-2341-4eaa-ad4b-300d005d43e4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:41.097141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0c12fc1c-2341-4eaa-ad4b-300d005d43e4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:41.107145 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0c12fc1c-2341-4eaa-ad4b-300d005d43e4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.107320 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0c12fc1c-2341-4eaa-ad4b-300d005d43e4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:41.108211 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0c12fc1c-2341-4eaa-ad4b-300d005d43e4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:41.108659 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0c12fc1c-2341-4eaa-ad4b-300d005d43e4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:41.148323 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6b50f59a-6efd-4176-ad8c-c9b769b6e5c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:41.155556 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:41.161823 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6b50f59a-6efd-4176-ad8c-c9b769b6e5c5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1302 microversion: 2.1 time: 0.116432 Jul 25 06:01:41.164434 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 146/304] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:41 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1302 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:41.282845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0c12fc1c-2341-4eaa-ad4b-300d005d43e4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:41.291428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0c12fc1c-2341-4eaa-ad4b-300d005d43e4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:41.293295 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0c12fc1c-2341-4eaa-ad4b-300d005d43e4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:41.294876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0c12fc1c-2341-4eaa-ad4b-300d005d43e4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.203141 Jul 25 06:01:41.295362 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 159/305] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:41 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:42.036617 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e1d02507-ce7b-495b-974e-da3609b5715b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:42.037232 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e1d02507-ce7b-495b-974e-da3609b5715b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:42.112526 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-e1d02507-ce7b-495b-974e-da3609b5715b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:42.119377 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e1d02507-ce7b-495b-974e-da3609b5715b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1242 microversion: 2.1 time: 0.086747 Jul 25 06:01:42.120157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 147/306] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:42 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:42.182791 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-357a2fff-f5f4-4bf5-80b2-c61828378670 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:42.183990 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-357a2fff-f5f4-4bf5-80b2-c61828378670 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:42.190252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-357a2fff-f5f4-4bf5-80b2-c61828378670 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.190706 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-357a2fff-f5f4-4bf5-80b2-c61828378670 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.191468 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-357a2fff-f5f4-4bf5-80b2-c61828378670 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.192231 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-357a2fff-f5f4-4bf5-80b2-c61828378670 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.314174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2eaf3cb7-2a49-4453-a29e-23c9e1597bcd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:42.314789 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2eaf3cb7-2a49-4453-a29e-23c9e1597bcd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:42.322212 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2eaf3cb7-2a49-4453-a29e-23c9e1597bcd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.323116 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2eaf3cb7-2a49-4453-a29e-23c9e1597bcd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.324995 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2eaf3cb7-2a49-4453-a29e-23c9e1597bcd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.325886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2eaf3cb7-2a49-4453-a29e-23c9e1597bcd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.359309 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-357a2fff-f5f4-4bf5-80b2-c61828378670 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:42.367450 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-357a2fff-f5f4-4bf5-80b2-c61828378670 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1370 microversion: 2.1 time: 0.188742 Jul 25 06:01:42.368030 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 160/307] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:42 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:42.587190 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2eaf3cb7-2a49-4453-a29e-23c9e1597bcd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:42.599379 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2eaf3cb7-2a49-4453-a29e-23c9e1597bcd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:42.600945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2eaf3cb7-2a49-4453-a29e-23c9e1597bcd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:42.613461 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2eaf3cb7-2a49-4453-a29e-23c9e1597bcd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.292651 Jul 25 06:01:42.613461 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 148/308] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:42 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:42.807713 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-672d4bb8-e6de-411c-b908-6b10b04bf150 req-807d3624-6a84-4fd8-aa0f-211e9043fa2c service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "e750488b-116b-4f02-a4bd-710c3867fa27", "tag": "f054b336-0d1e-4689-ae9f-d24089cd4d40"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:42.817535 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-672d4bb8-e6de-411c-b908-6b10b04bf150 req-807d3624-6a84-4fd8-aa0f-211e9043fa2c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:42.817990 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-672d4bb8-e6de-411c-b908-6b10b04bf150 req-807d3624-6a84-4fd8-aa0f-211e9043fa2c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:42.837018 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-672d4bb8-e6de-411c-b908-6b10b04bf150 req-807d3624-6a84-4fd8-aa0f-211e9043fa2c service nova] Creating event network-changed:f054b336-0d1e-4689-ae9f-d24089cd4d40 for instance e750488b-116b-4f02-a4bd-710c3867fa27 on hv-cinder-84841 Jul 25 06:01:42.842245 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-672d4bb8-e6de-411c-b908-6b10b04bf150 req-807d3624-6a84-4fd8-aa0f-211e9043fa2c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038653 Jul 25 06:01:42.842970 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 161/309] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:43.136186 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-af288d33-ed9d-4b87-9b4c-84ec452b4d37 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:43.139542 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-af288d33-ed9d-4b87-9b4c-84ec452b4d37 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:43.143951 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af288d33-ed9d-4b87-9b4c-84ec452b4d37 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.144422 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af288d33-ed9d-4b87-9b4c-84ec452b4d37 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.145179 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af288d33-ed9d-4b87-9b4c-84ec452b4d37 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.145913 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af288d33-ed9d-4b87-9b4c-84ec452b4d37 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.213812 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-af288d33-ed9d-4b87-9b4c-84ec452b4d37 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.230859 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-af288d33-ed9d-4b87-9b4c-84ec452b4d37 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1294 microversion: 2.1 time: 0.098494 Jul 25 06:01:43.232014 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 149/310] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:43 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:43.303082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-eaad579e-16df-4e60-9957-023235c9a9f4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Action: 'action', calling method: <bound method ServersController._stop_server of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f3c8e0>>, body: {"os-stop": {}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:43.310285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eaad579e-16df-4e60-9957-023235c9a9f4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.310804 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eaad579e-16df-4e60-9957-023235c9a9f4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.372092 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-eaad579e-16df-4e60-9957-023235c9a9f4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Going to try to stop instance {{(pid=124917) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 06:01:43.384320 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c3e65b01-6c38-4a8c-89f9-b50f305465a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:43.387394 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c3e65b01-6c38-4a8c-89f9-b50f305465a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:43.392023 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c3e65b01-6c38-4a8c-89f9-b50f305465a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.392602 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c3e65b01-6c38-4a8c-89f9-b50f305465a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.393427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c3e65b01-6c38-4a8c-89f9-b50f305465a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.393924 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c3e65b01-6c38-4a8c-89f9-b50f305465a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.548676 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-eaad579e-16df-4e60-9957-023235c9a9f4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "POST /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/action" status: 202 len: 0 microversion: 2.1 time: 0.248732 Jul 25 06:01:43.550984 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 162/311] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:01:43 2022] POST /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:01:43.564485 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-54666b81-6bf4-4c35-9356-c9d8343862fd tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:43.566512 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-54666b81-6bf4-4c35-9356-c9d8343862fd tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:43.580453 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-54666b81-6bf4-4c35-9356-c9d8343862fd tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.581520 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-54666b81-6bf4-4c35-9356-c9d8343862fd tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.582687 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-54666b81-6bf4-4c35-9356-c9d8343862fd tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.583503 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-54666b81-6bf4-4c35-9356-c9d8343862fd tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.592867 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c3e65b01-6c38-4a8c-89f9-b50f305465a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.602110 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c3e65b01-6c38-4a8c-89f9-b50f305465a8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1370 microversion: 2.1 time: 0.221640 Jul 25 06:01:43.602754 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 150/312] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:43 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:43.630885 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-00187e60-1f31-4f7a-bc1d-1ba608466805 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:43.632081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-00187e60-1f31-4f7a-bc1d-1ba608466805 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:43.639996 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-00187e60-1f31-4f7a-bc1d-1ba608466805 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.645791 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-00187e60-1f31-4f7a-bc1d-1ba608466805 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.645791 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-00187e60-1f31-4f7a-bc1d-1ba608466805 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.645791 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-00187e60-1f31-4f7a-bc1d-1ba608466805 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.777243 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-54666b81-6bf4-4c35-9356-c9d8343862fd tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.787104 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-54666b81-6bf4-4c35-9356-c9d8343862fd tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.229499 Jul 25 06:01:43.788091 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 163/313] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:43 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:43.797827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0208cdc7-e01c-45d1-9492-f8d9f6060d03 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f1c0>>, body: {"volumeAttachment": {"volumeId": "d775896b-ce05-4a6c-bf47-e82b7aa6eed7", "device": "/dev/sdb"}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:43.800567 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0208cdc7-e01c-45d1-9492-f8d9f6060d03 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:43.807731 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0208cdc7-e01c-45d1-9492-f8d9f6060d03 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.809046 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0208cdc7-e01c-45d1-9492-f8d9f6060d03 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.810419 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0208cdc7-e01c-45d1-9492-f8d9f6060d03 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:43.811242 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0208cdc7-e01c-45d1-9492-f8d9f6060d03 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:43.874814 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-00187e60-1f31-4f7a-bc1d-1ba608466805 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.883188 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-00187e60-1f31-4f7a-bc1d-1ba608466805 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.884703 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-00187e60-1f31-4f7a-bc1d-1ba608466805 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:43.889405 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-00187e60-1f31-4f7a-bc1d-1ba608466805 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.272272 Jul 25 06:01:43.889964 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 151/314] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:43 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:44.248591 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5f35b923-dbe4-49c0-a24e-13a1e72f6c87 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:44.249356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5f35b923-dbe4-49c0-a24e-13a1e72f6c87 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:44.256348 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f35b923-dbe4-49c0-a24e-13a1e72f6c87 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.256849 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f35b923-dbe4-49c0-a24e-13a1e72f6c87 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.257576 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f35b923-dbe4-49c0-a24e-13a1e72f6c87 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.258028 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f35b923-dbe4-49c0-a24e-13a1e72f6c87 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.341392 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5f35b923-dbe4-49c0-a24e-13a1e72f6c87 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:44.349403 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5f35b923-dbe4-49c0-a24e-13a1e72f6c87 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1312 microversion: 2.1 time: 0.105594 Jul 25 06:01:44.350051 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 152/315] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:44 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:44.619444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-bc59ad2b-c811-45f9-8e3a-f18615df77db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:44.621291 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-bc59ad2b-c811-45f9-8e3a-f18615df77db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:44.630673 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bc59ad2b-c811-45f9-8e3a-f18615df77db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.630673 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bc59ad2b-c811-45f9-8e3a-f18615df77db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.630673 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bc59ad2b-c811-45f9-8e3a-f18615df77db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.630673 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bc59ad2b-c811-45f9-8e3a-f18615df77db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.812594 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-bc59ad2b-c811-45f9-8e3a-f18615df77db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:44.820105 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-bc59ad2b-c811-45f9-8e3a-f18615df77db tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1370 microversion: 2.1 time: 0.204681 Jul 25 06:01:44.820769 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 153/316] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:44 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:44.831873 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-707b0c8d-b131-4088-abfd-c193887dd550 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:44.832641 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-707b0c8d-b131-4088-abfd-c193887dd550 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:44.833753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0208cdc7-e01c-45d1-9492-f8d9f6060d03 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "POST /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.043759 Jul 25 06:01:44.835771 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 164/317] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:01:43 2022] POST /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30/os-volume_attachments => generated 194 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:44.840016 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-707b0c8d-b131-4088-abfd-c193887dd550 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.843003 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-707b0c8d-b131-4088-abfd-c193887dd550 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.843003 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-707b0c8d-b131-4088-abfd-c193887dd550 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.843003 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-707b0c8d-b131-4088-abfd-c193887dd550 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.908945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-68d62b7a-e3bf-485a-b355-6aa3f2a9fa5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:44.909872 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-68d62b7a-e3bf-485a-b355-6aa3f2a9fa5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:44.916895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-68d62b7a-e3bf-485a-b355-6aa3f2a9fa5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.917731 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-68d62b7a-e3bf-485a-b355-6aa3f2a9fa5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:44.918670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-68d62b7a-e3bf-485a-b355-6aa3f2a9fa5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:44.919182 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-68d62b7a-e3bf-485a-b355-6aa3f2a9fa5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:45.026491 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-707b0c8d-b131-4088-abfd-c193887dd550 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:45.038810 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-707b0c8d-b131-4088-abfd-c193887dd550 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.211292 Jul 25 06:01:45.039779 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 154/318] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:44 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:45.139822 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-68d62b7a-e3bf-485a-b355-6aa3f2a9fa5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:45.148771 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-68d62b7a-e3bf-485a-b355-6aa3f2a9fa5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:45.150491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-68d62b7a-e3bf-485a-b355-6aa3f2a9fa5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:45.152527 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-68d62b7a-e3bf-485a-b355-6aa3f2a9fa5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.247254 Jul 25 06:01:45.153175 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 165/319] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:44 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:45.367085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4f04eeb7-2743-4eed-a62c-214c547d6caf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:45.367674 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4f04eeb7-2743-4eed-a62c-214c547d6caf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:45.374705 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f04eeb7-2743-4eed-a62c-214c547d6caf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:45.375143 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f04eeb7-2743-4eed-a62c-214c547d6caf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:45.375882 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f04eeb7-2743-4eed-a62c-214c547d6caf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:45.376351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f04eeb7-2743-4eed-a62c-214c547d6caf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:45.585081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4f04eeb7-2743-4eed-a62c-214c547d6caf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:45.595388 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4f04eeb7-2743-4eed-a62c-214c547d6caf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1367 microversion: 2.1 time: 0.232039 Jul 25 06:01:45.597016 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 155/320] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:45 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:45.838033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-11a04e1e-af71-4fa7-acd0-f2b25aaae9a2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:45.838792 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-11a04e1e-af71-4fa7-acd0-f2b25aaae9a2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:45.847473 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-11a04e1e-af71-4fa7-acd0-f2b25aaae9a2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:45.848267 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-11a04e1e-af71-4fa7-acd0-f2b25aaae9a2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:45.849360 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-11a04e1e-af71-4fa7-acd0-f2b25aaae9a2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:45.850281 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-11a04e1e-af71-4fa7-acd0-f2b25aaae9a2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.061380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-88d7ce5e-6553-40e3-bf3c-2f6aee9c62d4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:46.062005 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-88d7ce5e-6553-40e3-bf3c-2f6aee9c62d4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:46.069141 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-88d7ce5e-6553-40e3-bf3c-2f6aee9c62d4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.069586 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-88d7ce5e-6553-40e3-bf3c-2f6aee9c62d4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.070596 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-88d7ce5e-6553-40e3-bf3c-2f6aee9c62d4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.071033 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-88d7ce5e-6553-40e3-bf3c-2f6aee9c62d4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.265814 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-88d7ce5e-6553-40e3-bf3c-2f6aee9c62d4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:46.273455 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-11a04e1e-af71-4fa7-acd0-f2b25aaae9a2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:46.274521 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-88d7ce5e-6553-40e3-bf3c-2f6aee9c62d4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.218141 Jul 25 06:01:46.275089 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 156/321] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:46 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:46.281260 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7fc12df2-0149-4bf7-94ba-edfec17cf901 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:46.282071 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7fc12df2-0149-4bf7-94ba-edfec17cf901 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:46.282325 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-11a04e1e-af71-4fa7-acd0-f2b25aaae9a2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1370 microversion: 2.1 time: 0.448622 Jul 25 06:01:46.283285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 166/322] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:45 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1370 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:46.290556 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7fc12df2-0149-4bf7-94ba-edfec17cf901 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.291306 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7fc12df2-0149-4bf7-94ba-edfec17cf901 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.291831 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7fc12df2-0149-4bf7-94ba-edfec17cf901 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.293161 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7fc12df2-0149-4bf7-94ba-edfec17cf901 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.442864 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7fc12df2-0149-4bf7-94ba-edfec17cf901 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:46.454421 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7fc12df2-0149-4bf7-94ba-edfec17cf901 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:46.455940 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7fc12df2-0149-4bf7-94ba-edfec17cf901 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:46.457187 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7fc12df2-0149-4bf7-94ba-edfec17cf901 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.180896 Jul 25 06:01:46.457743 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 157/323] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:46 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:46.613561 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0c8904a8-fccf-4b09-a70f-5188da3f3b54 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:46.614466 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0c8904a8-fccf-4b09-a70f-5188da3f3b54 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:46.621555 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0c8904a8-fccf-4b09-a70f-5188da3f3b54 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.622190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0c8904a8-fccf-4b09-a70f-5188da3f3b54 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.622967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0c8904a8-fccf-4b09-a70f-5188da3f3b54 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.623587 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0c8904a8-fccf-4b09-a70f-5188da3f3b54 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.642801 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:46.802220 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-f3be9a5f-a208-4fd5-aed8-3e44d8d8e9ce req-948b1577-7038-452a-94dd-c450fe95012c service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "cffe93da-af1c-417f-8b03-0d6262028356", "tag": "1ed76246-6a82-44fa-b633-e34bc3bf0089"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:46.816103 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0c8904a8-fccf-4b09-a70f-5188da3f3b54 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:46.820527 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-f3be9a5f-a208-4fd5-aed8-3e44d8d8e9ce req-948b1577-7038-452a-94dd-c450fe95012c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:46.820527 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-f3be9a5f-a208-4fd5-aed8-3e44d8d8e9ce req-948b1577-7038-452a-94dd-c450fe95012c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:46.827064 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0c8904a8-fccf-4b09-a70f-5188da3f3b54 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1367 microversion: 2.1 time: 0.217390 Jul 25 06:01:46.827967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 167/324] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:46 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:46.842121 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-f3be9a5f-a208-4fd5-aed8-3e44d8d8e9ce req-948b1577-7038-452a-94dd-c450fe95012c service nova] Creating event network-changed:1ed76246-6a82-44fa-b633-e34bc3bf0089 for instance cffe93da-af1c-417f-8b03-0d6262028356 on hv-cinder-84841 Jul 25 06:01:46.849420 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-f3be9a5f-a208-4fd5-aed8-3e44d8d8e9ce req-948b1577-7038-452a-94dd-c450fe95012c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049953 Jul 25 06:01:46.849420 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 158/325] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:47.294562 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8eddefca-a193-45b1-91c5-e6bede28e874 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:47.295173 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8eddefca-a193-45b1-91c5-e6bede28e874 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:47.302147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8eddefca-a193-45b1-91c5-e6bede28e874 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.302591 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8eddefca-a193-45b1-91c5-e6bede28e874 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.303353 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8eddefca-a193-45b1-91c5-e6bede28e874 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.304221 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8eddefca-a193-45b1-91c5-e6bede28e874 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.310948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f10ebf89-94f0-4e53-ba52-fcd13bfc7c11 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:47.312043 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f10ebf89-94f0-4e53-ba52-fcd13bfc7c11 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:47.322851 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f10ebf89-94f0-4e53-ba52-fcd13bfc7c11 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.325095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f10ebf89-94f0-4e53-ba52-fcd13bfc7c11 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.326102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f10ebf89-94f0-4e53-ba52-fcd13bfc7c11 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.326771 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f10ebf89-94f0-4e53-ba52-fcd13bfc7c11 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.471533 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f10ebf89-94f0-4e53-ba52-fcd13bfc7c11 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:47.479204 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f10ebf89-94f0-4e53-ba52-fcd13bfc7c11 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1370 microversion: 2.1 time: 0.176024 Jul 25 06:01:47.479779 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 159/326] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:47 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:47.484413 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-87905060-4ebe-40bf-ac52-f824e3e518c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:47.485008 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-87905060-4ebe-40bf-ac52-f824e3e518c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:47.491014 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-87905060-4ebe-40bf-ac52-f824e3e518c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.491450 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-87905060-4ebe-40bf-ac52-f824e3e518c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.492246 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-87905060-4ebe-40bf-ac52-f824e3e518c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.492678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-87905060-4ebe-40bf-ac52-f824e3e518c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.499236 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8eddefca-a193-45b1-91c5-e6bede28e874 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:47.508108 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8eddefca-a193-45b1-91c5-e6bede28e874 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.218129 Jul 25 06:01:47.508707 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 168/327] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:47 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:47.625627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-87905060-4ebe-40bf-ac52-f824e3e518c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:47.633547 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-87905060-4ebe-40bf-ac52-f824e3e518c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:47.635045 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-87905060-4ebe-40bf-ac52-f824e3e518c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:47.637123 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-87905060-4ebe-40bf-ac52-f824e3e518c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.155480 Jul 25 06:01:47.638018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 160/328] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:47 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:47.843721 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-949933f2-e20c-447d-a4f9-4f171944fc66 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:47.846277 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-949933f2-e20c-447d-a4f9-4f171944fc66 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:47.846277 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:47.851185 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-949933f2-e20c-447d-a4f9-4f171944fc66 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.851626 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-949933f2-e20c-447d-a4f9-4f171944fc66 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:47.852404 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-949933f2-e20c-447d-a4f9-4f171944fc66 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:47.852837 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-949933f2-e20c-447d-a4f9-4f171944fc66 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.005021 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-949933f2-e20c-447d-a4f9-4f171944fc66 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:48.011308 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-949933f2-e20c-447d-a4f9-4f171944fc66 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1367 microversion: 2.1 time: 0.171293 Jul 25 06:01:48.012335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 169/329] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:47 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:48.349433 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5c4c0>>, body: {"server": {"name": "tempest-VolumesActionsTest-instance-655684221", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "networks": [{"uuid": "1387b5b1-b22c-45c9-8c0b-cbb5a7580640"}]}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:48.405824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.network.neutron [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] validate_networks() for [('1387b5b1-b22c-45c9-8c0b-cbb5a7580640', None, None, None, None, None)] {{(pid=124918) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:01:48.497312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4e3d01c9-c9eb-4c3d-8386-822d80ed20f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:48.497990 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4e3d01c9-c9eb-4c3d-8386-822d80ed20f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:48.504596 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4e3d01c9-c9eb-4c3d-8386-822d80ed20f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.505039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4e3d01c9-c9eb-4c3d-8386-822d80ed20f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.505796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4e3d01c9-c9eb-4c3d-8386-822d80ed20f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.506226 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4e3d01c9-c9eb-4c3d-8386-822d80ed20f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.648007 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4e3d01c9-c9eb-4c3d-8386-822d80ed20f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:48.656472 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4e3d01c9-c9eb-4c3d-8386-822d80ed20f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1370 microversion: 2.1 time: 0.163984 Jul 25 06:01:48.657035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 170/330] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:48 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:48.661402 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-10494b6b-1ad9-4775-86d0-b67708b86ad4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:48.664958 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-10494b6b-1ad9-4775-86d0-b67708b86ad4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:48.667655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-10494b6b-1ad9-4775-86d0-b67708b86ad4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.668446 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-10494b6b-1ad9-4775-86d0-b67708b86ad4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.669198 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-10494b6b-1ad9-4775-86d0-b67708b86ad4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.669630 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-10494b6b-1ad9-4775-86d0-b67708b86ad4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.793684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Flavor limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:01:48.793684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Image limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:01:48.793684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Flavor pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:01:48.793684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Image pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:01:48.793684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:01:48.801641 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.802091 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.802976 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.803407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.817775 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-10494b6b-1ad9-4775-86d0-b67708b86ad4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:48.827303 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-10494b6b-1ad9-4775-86d0-b67708b86ad4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.169255 Jul 25 06:01:48.836950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 171/331] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:48 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:48.841948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Getting quotas for project e3f62f9df69f47d0ad40154526b95be1. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:01:48.842167 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-913a1a6e-ea43-4580-bb35-861ba0208653 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:48.842167 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-913a1a6e-ea43-4580-bb35-861ba0208653 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:48.842167 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-913a1a6e-ea43-4580-bb35-861ba0208653 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.842167 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-913a1a6e-ea43-4580-bb35-861ba0208653 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.842490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-913a1a6e-ea43-4580-bb35-861ba0208653 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:48.842668 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-913a1a6e-ea43-4580-bb35-861ba0208653 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:48.843589 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Getting quotas for user 66f64211ceb949d398e47bc18e2abbca and project e3f62f9df69f47d0ad40154526b95be1. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:01:48.857529 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Going to run 1 instances... {{(pid=124918) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:01:48.859616 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:01:48.977757 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-913a1a6e-ea43-4580-bb35-861ba0208653 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:48.978687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3b5c99f8-abdc-4638-92a2-8289465461b2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633328 Jul 25 06:01:48.979695 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 161/332] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:01:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:01:48.986628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-913a1a6e-ea43-4580-bb35-861ba0208653 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:48.988167 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-913a1a6e-ea43-4580-bb35-861ba0208653 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:48.989323 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-913a1a6e-ea43-4580-bb35-861ba0208653 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.160057 Jul 25 06:01:48.989863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-405bc258-55d8-4364-82ea-72f4b5f5aa20 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:48.989990 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 172/333] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:48 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:48.990757 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-405bc258-55d8-4364-82ea-72f4b5f5aa20 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:48.992988 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:49.030703 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-634cf6ce-3370-4ce6-87ec-9d44e781252c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:49.042618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-634cf6ce-3370-4ce6-87ec-9d44e781252c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:49.042618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-634cf6ce-3370-4ce6-87ec-9d44e781252c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:49.042618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-634cf6ce-3370-4ce6-87ec-9d44e781252c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:49.042618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-634cf6ce-3370-4ce6-87ec-9d44e781252c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:49.043224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-634cf6ce-3370-4ce6-87ec-9d44e781252c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:49.210663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-634cf6ce-3370-4ce6-87ec-9d44e781252c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:49.219365 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-634cf6ce-3370-4ce6-87ec-9d44e781252c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1367 microversion: 2.1 time: 0.192647 Jul 25 06:01:49.219934 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 173/334] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:49 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:49.276495 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-405bc258-55d8-4364-82ea-72f4b5f5aa20 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:49.283323 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-405bc258-55d8-4364-82ea-72f4b5f5aa20 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1213 microversion: 2.1 time: 0.297718 Jul 25 06:01:49.284074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 162/335] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:48 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1213 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:49.679572 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9fcc7bae-8775-4847-934f-cc3a9a2b3d4d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:49.680233 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9fcc7bae-8775-4847-934f-cc3a9a2b3d4d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:49.688377 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9fcc7bae-8775-4847-934f-cc3a9a2b3d4d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:49.689037 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9fcc7bae-8775-4847-934f-cc3a9a2b3d4d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:49.689977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9fcc7bae-8775-4847-934f-cc3a9a2b3d4d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:49.690404 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9fcc7bae-8775-4847-934f-cc3a9a2b3d4d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:49.846456 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-72fdfe08-46a3-4610-aa6b-252fb3c98e83 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:49.848177 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-72fdfe08-46a3-4610-aa6b-252fb3c98e83 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:49.867142 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-72fdfe08-46a3-4610-aa6b-252fb3c98e83 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:49.867594 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-72fdfe08-46a3-4610-aa6b-252fb3c98e83 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:49.868240 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9fcc7bae-8775-4847-934f-cc3a9a2b3d4d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:49.868390 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-72fdfe08-46a3-4610-aa6b-252fb3c98e83 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:49.868830 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-72fdfe08-46a3-4610-aa6b-252fb3c98e83 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:49.882009 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9fcc7bae-8775-4847-934f-cc3a9a2b3d4d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1370 microversion: 2.1 time: 0.206132 Jul 25 06:01:49.894186 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 174/336] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:49 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:50.007740 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e26e61e9-1237-4169-9942-120062e88a08 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:50.008838 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e26e61e9-1237-4169-9942-120062e88a08 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:50.016717 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e26e61e9-1237-4169-9942-120062e88a08 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.017450 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e26e61e9-1237-4169-9942-120062e88a08 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.018522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e26e61e9-1237-4169-9942-120062e88a08 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.019107 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e26e61e9-1237-4169-9942-120062e88a08 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.047296 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-72fdfe08-46a3-4610-aa6b-252fb3c98e83 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:50.056333 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-72fdfe08-46a3-4610-aa6b-252fb3c98e83 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.215217 Jul 25 06:01:50.057149 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 163/337] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:49 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:50.070381 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-07cadd9a-cdc6-42ef-af9a-ca49921788ad req-db46ad44-0b3d-4882-84c3-62a70ef3116f service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "e750488b-116b-4f02-a4bd-710c3867fa27", "name": "network-vif-plugged", "status": "completed", "tag": "f054b336-0d1e-4689-ae9f-d24089cd4d40"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:50.080063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-07cadd9a-cdc6-42ef-af9a-ca49921788ad req-db46ad44-0b3d-4882-84c3-62a70ef3116f service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.080868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-07cadd9a-cdc6-42ef-af9a-ca49921788ad req-db46ad44-0b3d-4882-84c3-62a70ef3116f service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.094299 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-07cadd9a-cdc6-42ef-af9a-ca49921788ad req-db46ad44-0b3d-4882-84c3-62a70ef3116f service nova] Creating event network-vif-plugged:f054b336-0d1e-4689-ae9f-d24089cd4d40 for instance e750488b-116b-4f02-a4bd-710c3867fa27 on hv-cinder-84841 Jul 25 06:01:50.099330 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-07cadd9a-cdc6-42ef-af9a-ca49921788ad req-db46ad44-0b3d-4882-84c3-62a70ef3116f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040191 Jul 25 06:01:50.100450 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 164/338] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:50.212493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e26e61e9-1237-4169-9942-120062e88a08 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:50.222139 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e26e61e9-1237-4169-9942-120062e88a08 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:50.224240 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e26e61e9-1237-4169-9942-120062e88a08 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:50.228222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e26e61e9-1237-4169-9942-120062e88a08 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.221521 Jul 25 06:01:50.228222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 175/339] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:50 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:50.239113 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-17eb2d70-b5d4-4d96-9337-db3a4e7932cd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:50.239917 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-17eb2d70-b5d4-4d96-9337-db3a4e7932cd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:50.249674 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-17eb2d70-b5d4-4d96-9337-db3a4e7932cd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.250353 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-17eb2d70-b5d4-4d96-9337-db3a4e7932cd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.251506 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-17eb2d70-b5d4-4d96-9337-db3a4e7932cd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.252085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-17eb2d70-b5d4-4d96-9337-db3a4e7932cd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.300943 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ad92e161-31fe-4b64-b769-2f17cc6679f9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:50.301674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ad92e161-31fe-4b64-b769-2f17cc6679f9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:50.307835 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ad92e161-31fe-4b64-b769-2f17cc6679f9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.308680 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ad92e161-31fe-4b64-b769-2f17cc6679f9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.309511 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ad92e161-31fe-4b64-b769-2f17cc6679f9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.310009 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ad92e161-31fe-4b64-b769-2f17cc6679f9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.372925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ad92e161-31fe-4b64-b769-2f17cc6679f9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:50.382400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ad92e161-31fe-4b64-b769-2f17cc6679f9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1217 microversion: 2.1 time: 0.085119 Jul 25 06:01:50.387299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 176/340] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:50 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:50.416082 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-17eb2d70-b5d4-4d96-9337-db3a4e7932cd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:50.424049 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-17eb2d70-b5d4-4d96-9337-db3a4e7932cd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1367 microversion: 2.1 time: 0.192066 Jul 25 06:01:50.431265 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 165/341] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:50 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:50.900378 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-58072132-7a5c-4c26-866a-9896dc42af76 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:50.901025 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-58072132-7a5c-4c26-866a-9896dc42af76 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:50.907938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-58072132-7a5c-4c26-866a-9896dc42af76 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.908425 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-58072132-7a5c-4c26-866a-9896dc42af76 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:50.909199 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-58072132-7a5c-4c26-866a-9896dc42af76 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:50.913096 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-58072132-7a5c-4c26-866a-9896dc42af76 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.011910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=8 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:51.044727 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-58072132-7a5c-4c26-866a-9896dc42af76 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:51.052135 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-58072132-7a5c-4c26-866a-9896dc42af76 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1370 microversion: 2.1 time: 0.155730 Jul 25 06:01:51.052710 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 177/342] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:50 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:51.076202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-49c4822c-1263-4f70-8578-3cceadaed3f0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:51.076202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-49c4822c-1263-4f70-8578-3cceadaed3f0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:51.080821 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49c4822c-1263-4f70-8578-3cceadaed3f0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.081261 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49c4822c-1263-4f70-8578-3cceadaed3f0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.082009 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49c4822c-1263-4f70-8578-3cceadaed3f0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.082436 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49c4822c-1263-4f70-8578-3cceadaed3f0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.213059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-49c4822c-1263-4f70-8578-3cceadaed3f0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:51.221033 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-49c4822c-1263-4f70-8578-3cceadaed3f0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.151373 Jul 25 06:01:51.225261 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 166/343] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:51 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:51.245494 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e50ff124-f055-4f2f-b4eb-da5afc93622b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:51.246199 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e50ff124-f055-4f2f-b4eb-da5afc93622b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:51.252683 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e50ff124-f055-4f2f-b4eb-da5afc93622b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.253302 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e50ff124-f055-4f2f-b4eb-da5afc93622b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.254115 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e50ff124-f055-4f2f-b4eb-da5afc93622b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.254627 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e50ff124-f055-4f2f-b4eb-da5afc93622b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.385659 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e50ff124-f055-4f2f-b4eb-da5afc93622b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:51.394314 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e50ff124-f055-4f2f-b4eb-da5afc93622b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:51.396078 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e50ff124-f055-4f2f-b4eb-da5afc93622b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:51.397245 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e50ff124-f055-4f2f-b4eb-da5afc93622b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.156240 Jul 25 06:01:51.397790 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 178/344] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:51 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:51.400343 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-94ff554f-7b97-4a66-84ea-ddca624c9a22 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:51.400988 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-94ff554f-7b97-4a66-84ea-ddca624c9a22 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:51.407298 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-94ff554f-7b97-4a66-84ea-ddca624c9a22 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.407748 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-94ff554f-7b97-4a66-84ea-ddca624c9a22 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.408553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-94ff554f-7b97-4a66-84ea-ddca624c9a22 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.408987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-94ff554f-7b97-4a66-84ea-ddca624c9a22 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.426750 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=100 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:51.446013 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9a535a6b-4f15-4feb-a237-9a6d361cc852 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:51.446637 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9a535a6b-4f15-4feb-a237-9a6d361cc852 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:51.453689 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9a535a6b-4f15-4feb-a237-9a6d361cc852 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.454136 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9a535a6b-4f15-4feb-a237-9a6d361cc852 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.454904 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9a535a6b-4f15-4feb-a237-9a6d361cc852 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:51.455420 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9a535a6b-4f15-4feb-a237-9a6d361cc852 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:51.472915 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-94ff554f-7b97-4a66-84ea-ddca624c9a22 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:51.480339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-94ff554f-7b97-4a66-84ea-ddca624c9a22 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1265 microversion: 2.1 time: 0.083869 Jul 25 06:01:51.480903 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 167/345] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:51 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:51.593747 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9a535a6b-4f15-4feb-a237-9a6d361cc852 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:51.601366 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9a535a6b-4f15-4feb-a237-9a6d361cc852 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1367 microversion: 2.1 time: 0.159467 Jul 25 06:01:51.605785 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 179/346] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:51 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:52.070568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d6d17e0d-accf-4bac-aaa8-396961b546fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:52.071209 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d6d17e0d-accf-4bac-aaa8-396961b546fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:52.078828 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d6d17e0d-accf-4bac-aaa8-396961b546fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.083603 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d6d17e0d-accf-4bac-aaa8-396961b546fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.083603 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d6d17e0d-accf-4bac-aaa8-396961b546fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.083603 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d6d17e0d-accf-4bac-aaa8-396961b546fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.114453 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-9f958bb7-ecb4-49a5-b00c-ef19f60ffd3b req-13013012-1bb3-48cd-a4b2-c0f4a5f4d0dc service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "cffe93da-af1c-417f-8b03-0d6262028356", "name": "network-vif-plugged", "status": "completed", "tag": "1ed76246-6a82-44fa-b633-e34bc3bf0089"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:52.124143 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-9f958bb7-ecb4-49a5-b00c-ef19f60ffd3b req-13013012-1bb3-48cd-a4b2-c0f4a5f4d0dc service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.133579 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-9f958bb7-ecb4-49a5-b00c-ef19f60ffd3b req-13013012-1bb3-48cd-a4b2-c0f4a5f4d0dc service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.136865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-9f958bb7-ecb4-49a5-b00c-ef19f60ffd3b req-13013012-1bb3-48cd-a4b2-c0f4a5f4d0dc service nova] Creating event network-vif-plugged:1ed76246-6a82-44fa-b633-e34bc3bf0089 for instance cffe93da-af1c-417f-8b03-0d6262028356 on hv-cinder-84841 Jul 25 06:01:52.141942 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-9f958bb7-ecb4-49a5-b00c-ef19f60ffd3b req-13013012-1bb3-48cd-a4b2-c0f4a5f4d0dc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 Jul 25 06:01:52.142549 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 180/347] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:52.218930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d6d17e0d-accf-4bac-aaa8-396961b546fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:52.225079 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d6d17e0d-accf-4bac-aaa8-396961b546fd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1370 microversion: 2.1 time: 0.158594 Jul 25 06:01:52.225675 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 168/348] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:52 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:52.240831 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f0b44a6f-0c1d-46ee-ba7f-05a383fca534 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:52.241673 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f0b44a6f-0c1d-46ee-ba7f-05a383fca534 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:52.250808 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0b44a6f-0c1d-46ee-ba7f-05a383fca534 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.251263 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0b44a6f-0c1d-46ee-ba7f-05a383fca534 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.252212 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0b44a6f-0c1d-46ee-ba7f-05a383fca534 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.252647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0b44a6f-0c1d-46ee-ba7f-05a383fca534 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.393792 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f0b44a6f-0c1d-46ee-ba7f-05a383fca534 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:52.402979 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f0b44a6f-0c1d-46ee-ba7f-05a383fca534 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.168134 Jul 25 06:01:52.403617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 181/349] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:52 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:52.415972 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-cf4e99e0-c14b-412e-a1b9-a33aa711a056 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:52.416700 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-cf4e99e0-c14b-412e-a1b9-a33aa711a056 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:52.422917 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cf4e99e0-c14b-412e-a1b9-a33aa711a056 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.423362 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cf4e99e0-c14b-412e-a1b9-a33aa711a056 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.424282 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cf4e99e0-c14b-412e-a1b9-a33aa711a056 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.424715 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cf4e99e0-c14b-412e-a1b9-a33aa711a056 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.498054 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-155c104a-c405-4059-b9d5-2c2e44196e2a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:52.498976 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-155c104a-c405-4059-b9d5-2c2e44196e2a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:52.505419 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-155c104a-c405-4059-b9d5-2c2e44196e2a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.505786 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-155c104a-c405-4059-b9d5-2c2e44196e2a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.506540 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-155c104a-c405-4059-b9d5-2c2e44196e2a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.506970 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-155c104a-c405-4059-b9d5-2c2e44196e2a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.554060 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cf4e99e0-c14b-412e-a1b9-a33aa711a056 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:52.562221 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cf4e99e0-c14b-412e-a1b9-a33aa711a056 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:52.563712 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cf4e99e0-c14b-412e-a1b9-a33aa711a056 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:52.564878 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-cf4e99e0-c14b-412e-a1b9-a33aa711a056 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.153026 Jul 25 06:01:52.565434 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 169/350] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:52 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:52.571646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-155c104a-c405-4059-b9d5-2c2e44196e2a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:52.580371 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-155c104a-c405-4059-b9d5-2c2e44196e2a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1273 microversion: 2.1 time: 0.086655 Jul 25 06:01:52.580917 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 182/351] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:52 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:52.620329 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-64c11716-5204-40dc-9e87-9e74c471c171 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:52.621256 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-64c11716-5204-40dc-9e87-9e74c471c171 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:52.627288 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-64c11716-5204-40dc-9e87-9e74c471c171 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.627726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-64c11716-5204-40dc-9e87-9e74c471c171 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.628507 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-64c11716-5204-40dc-9e87-9e74c471c171 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:52.628928 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-64c11716-5204-40dc-9e87-9e74c471c171 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:52.764420 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-64c11716-5204-40dc-9e87-9e74c471c171 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:52.772077 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-64c11716-5204-40dc-9e87-9e74c471c171 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1367 microversion: 2.1 time: 0.155677 Jul 25 06:01:52.772662 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 170/352] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:52 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:53.241907 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-90c602a5-9f42-4c2c-b0e9-c4bdf860dc80 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:53.242519 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-90c602a5-9f42-4c2c-b0e9-c4bdf860dc80 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:53.249285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-90c602a5-9f42-4c2c-b0e9-c4bdf860dc80 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.249726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-90c602a5-9f42-4c2c-b0e9-c4bdf860dc80 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.250473 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-90c602a5-9f42-4c2c-b0e9-c4bdf860dc80 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.250899 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-90c602a5-9f42-4c2c-b0e9-c4bdf860dc80 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.383939 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-90c602a5-9f42-4c2c-b0e9-c4bdf860dc80 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:53.392284 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-90c602a5-9f42-4c2c-b0e9-c4bdf860dc80 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1564 microversion: 2.1 time: 0.154205 Jul 25 06:01:53.392834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 183/353] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:53 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:53.410093 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-35d4ef4e-2893-4dbf-ab68-71efa2c48fcc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method InterfaceAttachmentController.index of <nova.api.openstack.compute.attach_interfaces.InterfaceAttachmentController object at 0x7f6533f0dd90>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:53.410603 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-35d4ef4e-2893-4dbf-ab68-71efa2c48fcc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:53.417324 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-35d4ef4e-2893-4dbf-ab68-71efa2c48fcc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.417830 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-35d4ef4e-2893-4dbf-ab68-71efa2c48fcc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.419248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-35d4ef4e-2893-4dbf-ab68-71efa2c48fcc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.419881 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-35d4ef4e-2893-4dbf-ab68-71efa2c48fcc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.427740 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1bbf43d1-7e0e-400a-ab1d-3df9b4a2f8d7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:53.428455 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1bbf43d1-7e0e-400a-ab1d-3df9b4a2f8d7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:53.435347 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1bbf43d1-7e0e-400a-ab1d-3df9b4a2f8d7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.435794 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1bbf43d1-7e0e-400a-ab1d-3df9b4a2f8d7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.436582 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1bbf43d1-7e0e-400a-ab1d-3df9b4a2f8d7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.437012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1bbf43d1-7e0e-400a-ab1d-3df9b4a2f8d7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.502232 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-35d4ef4e-2893-4dbf-ab68-71efa2c48fcc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095985 Jul 25 06:01:53.502829 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 171/354] 10.222.0.40 () {58 vars in 1274 bytes} [Mon Jul 25 06:01:53 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:53.585468 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ff1744b2-7590-4510-8b6b-8023de6fc36c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:53.586436 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ff1744b2-7590-4510-8b6b-8023de6fc36c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:53.594594 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ff1744b2-7590-4510-8b6b-8023de6fc36c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.595353 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ff1744b2-7590-4510-8b6b-8023de6fc36c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.596229 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ff1744b2-7590-4510-8b6b-8023de6fc36c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.596750 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ff1744b2-7590-4510-8b6b-8023de6fc36c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.652173 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1bbf43d1-7e0e-400a-ab1d-3df9b4a2f8d7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:53.655554 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:53.660463 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1bbf43d1-7e0e-400a-ab1d-3df9b4a2f8d7 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.236608 Jul 25 06:01:53.661032 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 184/355] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:53 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:53.689762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d2a01200-6910-4c5f-94d0-6bfb2fd0535e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:53.690642 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d2a01200-6910-4c5f-94d0-6bfb2fd0535e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:53.709003 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d2a01200-6910-4c5f-94d0-6bfb2fd0535e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.709442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d2a01200-6910-4c5f-94d0-6bfb2fd0535e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.710207 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d2a01200-6910-4c5f-94d0-6bfb2fd0535e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.710810 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d2a01200-6910-4c5f-94d0-6bfb2fd0535e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.806919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d2a01200-6910-4c5f-94d0-6bfb2fd0535e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:53.814045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d2a01200-6910-4c5f-94d0-6bfb2fd0535e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1273 microversion: 2.1 time: 0.151251 Jul 25 06:01:53.815331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 185/356] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:53 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:53.820332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2168fada-822d-48f2-9bfc-71184bd08409 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:53.821127 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2168fada-822d-48f2-9bfc-71184bd08409 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:53.837748 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2168fada-822d-48f2-9bfc-71184bd08409 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.838302 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2168fada-822d-48f2-9bfc-71184bd08409 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.839907 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2168fada-822d-48f2-9bfc-71184bd08409 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:53.840574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2168fada-822d-48f2-9bfc-71184bd08409 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:53.898719 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ff1744b2-7590-4510-8b6b-8023de6fc36c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:53.913416 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ff1744b2-7590-4510-8b6b-8023de6fc36c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:53.915784 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ff1744b2-7590-4510-8b6b-8023de6fc36c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:53.919927 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ff1744b2-7590-4510-8b6b-8023de6fc36c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.335863 Jul 25 06:01:53.920992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 172/357] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:53 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:54.020297 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2168fada-822d-48f2-9bfc-71184bd08409 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:54.028395 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2168fada-822d-48f2-9bfc-71184bd08409 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1367 microversion: 2.1 time: 0.211875 Jul 25 06:01:54.028951 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 186/358] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:53 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:54.678667 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ee278606-81e2-48ce-9677-bba1dfea6297 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:54.679971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ee278606-81e2-48ce-9677-bba1dfea6297 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:54.688923 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ee278606-81e2-48ce-9677-bba1dfea6297 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:54.689394 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ee278606-81e2-48ce-9677-bba1dfea6297 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:54.690405 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ee278606-81e2-48ce-9677-bba1dfea6297 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:54.690841 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ee278606-81e2-48ce-9677-bba1dfea6297 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:54.737973 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-a7f586ad-5f7a-42f5-9d09-6d4ba7452548 req-2f1de979-fcd4-4875-b837-17a8d805c6ad service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "e750488b-116b-4f02-a4bd-710c3867fa27", "tag": "f054b336-0d1e-4689-ae9f-d24089cd4d40"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:54.746666 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-a7f586ad-5f7a-42f5-9d09-6d4ba7452548 req-2f1de979-fcd4-4875-b837-17a8d805c6ad service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:54.747104 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-a7f586ad-5f7a-42f5-9d09-6d4ba7452548 req-2f1de979-fcd4-4875-b837-17a8d805c6ad service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:54.759457 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-a7f586ad-5f7a-42f5-9d09-6d4ba7452548 req-2f1de979-fcd4-4875-b837-17a8d805c6ad service nova] Creating event network-changed:f054b336-0d1e-4689-ae9f-d24089cd4d40 for instance e750488b-116b-4f02-a4bd-710c3867fa27 on hv-cinder-84841 Jul 25 06:01:54.766524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-a7f586ad-5f7a-42f5-9d09-6d4ba7452548 req-2f1de979-fcd4-4875-b837-17a8d805c6ad service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032271 Jul 25 06:01:54.767794 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 187/359] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:54.860330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4462a35e-29b0-462b-9f3b-27a74458bea9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:54.865423 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4462a35e-29b0-462b-9f3b-27a74458bea9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:54.884269 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4462a35e-29b0-462b-9f3b-27a74458bea9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:54.890651 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ee278606-81e2-48ce-9677-bba1dfea6297 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:54.890811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4462a35e-29b0-462b-9f3b-27a74458bea9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:54.890811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4462a35e-29b0-462b-9f3b-27a74458bea9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:54.892581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4462a35e-29b0-462b-9f3b-27a74458bea9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:54.896864 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ee278606-81e2-48ce-9677-bba1dfea6297 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.222361 Jul 25 06:01:54.897487 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 173/360] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:54 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:54.939316 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-40eb3f7f-c837-4c08-9850-83131499be97 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:54.940244 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-40eb3f7f-c837-4c08-9850-83131499be97 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:54.946814 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-40eb3f7f-c837-4c08-9850-83131499be97 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:54.947402 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-40eb3f7f-c837-4c08-9850-83131499be97 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:54.948311 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-40eb3f7f-c837-4c08-9850-83131499be97 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:54.949267 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-40eb3f7f-c837-4c08-9850-83131499be97 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:55.103059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-40eb3f7f-c837-4c08-9850-83131499be97 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:55.112951 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-40eb3f7f-c837-4c08-9850-83131499be97 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:55.114503 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-40eb3f7f-c837-4c08-9850-83131499be97 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:55.115999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-40eb3f7f-c837-4c08-9850-83131499be97 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1742 microversion: 2.20 time: 0.181077 Jul 25 06:01:55.116589 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 174/361] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:54 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:55.122924 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-dbe777dc-aba9-4227-9540-ad00d0f25ef6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:55.123532 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-dbe777dc-aba9-4227-9540-ad00d0f25ef6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:55.130585 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dbe777dc-aba9-4227-9540-ad00d0f25ef6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:55.131528 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dbe777dc-aba9-4227-9540-ad00d0f25ef6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:55.132338 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dbe777dc-aba9-4227-9540-ad00d0f25ef6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:55.132771 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dbe777dc-aba9-4227-9540-ad00d0f25ef6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:55.247571 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4462a35e-29b0-462b-9f3b-27a74458bea9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:55.259674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4462a35e-29b0-462b-9f3b-27a74458bea9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.422750 Jul 25 06:01:55.271402 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 188/362] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:54 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:55.279875 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-dbe777dc-aba9-4227-9540-ad00d0f25ef6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:55.288223 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-dbe777dc-aba9-4227-9540-ad00d0f25ef6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1367 microversion: 2.1 time: 0.170238 Jul 25 06:01:55.288856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 175/363] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:55 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:55.917455 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f63366ed-4bd5-482e-b75b-161cc4fbb34c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:55.918254 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f63366ed-4bd5-482e-b75b-161cc4fbb34c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:55.920865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:55.926490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f63366ed-4bd5-482e-b75b-161cc4fbb34c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:55.927019 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f63366ed-4bd5-482e-b75b-161cc4fbb34c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:55.927952 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f63366ed-4bd5-482e-b75b-161cc4fbb34c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:55.929055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f63366ed-4bd5-482e-b75b-161cc4fbb34c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.103554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-f1684046-a4ec-4eaf-9b4f-c2a74d0e4720 req-389cafa2-3a8b-4b08-9842-f5c1e1c6ab28 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "7c1d7240-ffe0-424b-aa2c-f44036123979", "tag": "76c263b9-b74b-41c2-b7e7-d3f293d10eea"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:56.118454 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-f1684046-a4ec-4eaf-9b4f-c2a74d0e4720 req-389cafa2-3a8b-4b08-9842-f5c1e1c6ab28 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.119261 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-f1684046-a4ec-4eaf-9b4f-c2a74d0e4720 req-389cafa2-3a8b-4b08-9842-f5c1e1c6ab28 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.139012 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-f1684046-a4ec-4eaf-9b4f-c2a74d0e4720 req-389cafa2-3a8b-4b08-9842-f5c1e1c6ab28 service nova] Creating event network-changed:76c263b9-b74b-41c2-b7e7-d3f293d10eea for instance 7c1d7240-ffe0-424b-aa2c-f44036123979 on hv-cinder-84841 Jul 25 06:01:56.145475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-f1684046-a4ec-4eaf-9b4f-c2a74d0e4720 req-389cafa2-3a8b-4b08-9842-f5c1e1c6ab28 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049646 Jul 25 06:01:56.146580 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 176/364] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:01:56.156409 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-605409dd-1a2d-4fac-8b17-c5887ac550e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:56.157227 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-605409dd-1a2d-4fac-8b17-c5887ac550e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:56.166480 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-605409dd-1a2d-4fac-8b17-c5887ac550e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.167245 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-605409dd-1a2d-4fac-8b17-c5887ac550e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.168297 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-605409dd-1a2d-4fac-8b17-c5887ac550e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.169280 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-605409dd-1a2d-4fac-8b17-c5887ac550e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.181074 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f63366ed-4bd5-482e-b75b-161cc4fbb34c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:56.203298 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f63366ed-4bd5-482e-b75b-161cc4fbb34c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.292170 Jul 25 06:01:56.214511 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 189/365] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:55 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:56.279648 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-bf65a0d8-35c7-46c5-baf0-97892604d11c tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:56.280554 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-bf65a0d8-35c7-46c5-baf0-97892604d11c tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:56.294213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bf65a0d8-35c7-46c5-baf0-97892604d11c tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.294755 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bf65a0d8-35c7-46c5-baf0-97892604d11c tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.296242 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bf65a0d8-35c7-46c5-baf0-97892604d11c tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.296679 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bf65a0d8-35c7-46c5-baf0-97892604d11c tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.444187 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-605409dd-1a2d-4fac-8b17-c5887ac550e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:56.454080 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-605409dd-1a2d-4fac-8b17-c5887ac550e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:56.455630 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-605409dd-1a2d-4fac-8b17-c5887ac550e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:56.457300 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-605409dd-1a2d-4fac-8b17-c5887ac550e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1742 microversion: 2.20 time: 0.309044 Jul 25 06:01:56.458034 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 177/366] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:56 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1742 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:56.462670 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f75d256e-0201-4bcf-8944-dde63900b24a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:56.463354 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f75d256e-0201-4bcf-8944-dde63900b24a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:56.469744 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f75d256e-0201-4bcf-8944-dde63900b24a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.470395 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f75d256e-0201-4bcf-8944-dde63900b24a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.471070 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f75d256e-0201-4bcf-8944-dde63900b24a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.471507 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f75d256e-0201-4bcf-8944-dde63900b24a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.529670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-bf65a0d8-35c7-46c5-baf0-97892604d11c tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:56.539900 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-bf65a0d8-35c7-46c5-baf0-97892604d11c tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.266215 Jul 25 06:01:56.540934 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 190/367] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:56 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:56.625504 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f75d256e-0201-4bcf-8944-dde63900b24a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:56.633055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f75d256e-0201-4bcf-8944-dde63900b24a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1556 microversion: 2.1 time: 0.173961 Jul 25 06:01:56.633617 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 178/368] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:56 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:56.652045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d4fa9d99-7d44-4e94-b9a4-533da63352b0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method InterfaceAttachmentController.index of <nova.api.openstack.compute.attach_interfaces.InterfaceAttachmentController object at 0x7f6533e93e80>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:56.652646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d4fa9d99-7d44-4e94-b9a4-533da63352b0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:56.658933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d4fa9d99-7d44-4e94-b9a4-533da63352b0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.659493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d4fa9d99-7d44-4e94-b9a4-533da63352b0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.660359 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d4fa9d99-7d44-4e94-b9a4-533da63352b0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:56.660960 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d4fa9d99-7d44-4e94-b9a4-533da63352b0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:56.750175 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d4fa9d99-7d44-4e94-b9a4-533da63352b0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102454 Jul 25 06:01:56.750780 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 191/369] 10.222.0.40 () {58 vars in 1274 bytes} [Mon Jul 25 06:01:56 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:57.220710 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ab3dee99-3aef-44a9-bbfa-143631ff4500 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:57.221313 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ab3dee99-3aef-44a9-bbfa-143631ff4500 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:57.228043 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab3dee99-3aef-44a9-bbfa-143631ff4500 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:57.228518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab3dee99-3aef-44a9-bbfa-143631ff4500 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:57.229361 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab3dee99-3aef-44a9-bbfa-143631ff4500 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:57.229927 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab3dee99-3aef-44a9-bbfa-143631ff4500 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:57.475593 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d0c53b99-109c-490a-bf8b-d75602e42375 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:57.476223 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d0c53b99-109c-490a-bf8b-d75602e42375 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:57.482578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0c53b99-109c-490a-bf8b-d75602e42375 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:57.483026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0c53b99-109c-490a-bf8b-d75602e42375 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:57.483804 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0c53b99-109c-490a-bf8b-d75602e42375 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:57.484262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0c53b99-109c-490a-bf8b-d75602e42375 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:57.634796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d0c53b99-109c-490a-bf8b-d75602e42375 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:57.643825 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d0c53b99-109c-490a-bf8b-d75602e42375 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:57.645921 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d0c53b99-109c-490a-bf8b-d75602e42375 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:57.647125 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d0c53b99-109c-490a-bf8b-d75602e42375 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1742 microversion: 2.20 time: 0.175997 Jul 25 06:01:57.648215 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 192/370] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:57 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:01:57.654448 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-92565497-669f-4e1d-a772-783b1f1ef6a0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:57.660592 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-92565497-669f-4e1d-a772-783b1f1ef6a0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:57.660723 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ab3dee99-3aef-44a9-bbfa-143631ff4500 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:57.663919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-92565497-669f-4e1d-a772-783b1f1ef6a0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:57.665086 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-92565497-669f-4e1d-a772-783b1f1ef6a0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:57.665432 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ab3dee99-3aef-44a9-bbfa-143631ff4500 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.448487 Jul 25 06:01:57.665891 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-92565497-669f-4e1d-a772-783b1f1ef6a0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:57.666020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 179/371] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:57 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:57.666650 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-92565497-669f-4e1d-a772-783b1f1ef6a0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:57.806216 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-92565497-669f-4e1d-a772-783b1f1ef6a0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:57.815250 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-92565497-669f-4e1d-a772-783b1f1ef6a0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.165798 Jul 25 06:01:57.815957 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 193/372] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:57 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:58.040900 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-8dcc9450-f4e1-41c6-9257-b5b52ea8dfae req-9e0d9707-85b9-45d9-aa3b-23180fcfd792 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "cffe93da-af1c-417f-8b03-0d6262028356", "tag": "1ed76246-6a82-44fa-b633-e34bc3bf0089"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:58.049962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-8dcc9450-f4e1-41c6-9257-b5b52ea8dfae req-9e0d9707-85b9-45d9-aa3b-23180fcfd792 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:58.050413 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-8dcc9450-f4e1-41c6-9257-b5b52ea8dfae req-9e0d9707-85b9-45d9-aa3b-23180fcfd792 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:58.061606 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-8dcc9450-f4e1-41c6-9257-b5b52ea8dfae req-9e0d9707-85b9-45d9-aa3b-23180fcfd792 service nova] Creating event network-changed:1ed76246-6a82-44fa-b633-e34bc3bf0089 for instance cffe93da-af1c-417f-8b03-0d6262028356 on hv-cinder-84841 Jul 25 06:01:58.067366 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-8dcc9450-f4e1-41c6-9257-b5b52ea8dfae req-9e0d9707-85b9-45d9-aa3b-23180fcfd792 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030135 Jul 25 06:01:58.068212 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 180/373] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:58.665743 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-64ae7ea0-548f-4391-8981-85a33d16e7d1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:58.667061 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-64ae7ea0-548f-4391-8981-85a33d16e7d1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:58.673756 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64ae7ea0-548f-4391-8981-85a33d16e7d1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:58.674284 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64ae7ea0-548f-4391-8981-85a33d16e7d1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:58.675125 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64ae7ea0-548f-4391-8981-85a33d16e7d1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:58.675636 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64ae7ea0-548f-4391-8981-85a33d16e7d1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:58.684837 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b900bef7-e7b0-43dd-83de-1d6d3fbe350e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:58.686102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b900bef7-e7b0-43dd-83de-1d6d3fbe350e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:58.693111 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b900bef7-e7b0-43dd-83de-1d6d3fbe350e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:58.693550 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b900bef7-e7b0-43dd-83de-1d6d3fbe350e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:58.699634 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b900bef7-e7b0-43dd-83de-1d6d3fbe350e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:58.699634 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b900bef7-e7b0-43dd-83de-1d6d3fbe350e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:58.811715 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=4 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:58.818445 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-64ae7ea0-548f-4391-8981-85a33d16e7d1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:58.828575 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-64ae7ea0-548f-4391-8981-85a33d16e7d1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:58.830102 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-64ae7ea0-548f-4391-8981-85a33d16e7d1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:58.831309 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-64ae7ea0-548f-4391-8981-85a33d16e7d1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1742 microversion: 2.20 time: 0.169567 Jul 25 06:01:58.831869 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 194/374] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:58 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:01:58.836526 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a6263404-b86d-4cae-a08a-4f5056ac61fb tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:58.837140 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-a6263404-b86d-4cae-a08a-4f5056ac61fb tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:58.841052 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b900bef7-e7b0-43dd-83de-1d6d3fbe350e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:58.844315 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a6263404-b86d-4cae-a08a-4f5056ac61fb tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:58.845264 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a6263404-b86d-4cae-a08a-4f5056ac61fb tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:58.846152 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a6263404-b86d-4cae-a08a-4f5056ac61fb tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:58.846659 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a6263404-b86d-4cae-a08a-4f5056ac61fb tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:58.849357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b900bef7-e7b0-43dd-83de-1d6d3fbe350e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.170191 Jul 25 06:01:58.849926 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 181/375] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:58 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:01:58.986849 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a6263404-b86d-4cae-a08a-4f5056ac61fb tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:01:58.994251 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a6263404-b86d-4cae-a08a-4f5056ac61fb tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.161407 Jul 25 06:01:58.994869 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 195/376] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:58 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:01:59.170253 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-92cc99c0-e10b-4611-9100-703f3929433f req-1cfcd3d6-6e19-4d07-92b6-c9c49da92ad0 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "b2dc5c54-08fc-4392-a4b9-f1970578ffb7", "name": "network-vif-plugged", "status": "completed", "tag": "c86fe1cd-ba90-483f-8c21-3093b1ee753e"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:01:59.174065 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-92cc99c0-e10b-4611-9100-703f3929433f req-1cfcd3d6-6e19-4d07-92b6-c9c49da92ad0 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:59.174504 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-92cc99c0-e10b-4611-9100-703f3929433f req-1cfcd3d6-6e19-4d07-92b6-c9c49da92ad0 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:59.186033 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-92cc99c0-e10b-4611-9100-703f3929433f req-1cfcd3d6-6e19-4d07-92b6-c9c49da92ad0 service nova] Creating event network-vif-plugged:c86fe1cd-ba90-483f-8c21-3093b1ee753e for instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 on hv-cinder-84841 Jul 25 06:01:59.190865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-92cc99c0-e10b-4611-9100-703f3929433f req-1cfcd3d6-6e19-4d07-92b6-c9c49da92ad0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029610 Jul 25 06:01:59.194214 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 182/377] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:01:59.850851 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-afee293e-8631-4cb6-891e-2dde9d1e37c1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:59.851460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-afee293e-8631-4cb6-891e-2dde9d1e37c1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:59.858569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-afee293e-8631-4cb6-891e-2dde9d1e37c1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:59.859006 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-afee293e-8631-4cb6-891e-2dde9d1e37c1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:59.859756 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-afee293e-8631-4cb6-891e-2dde9d1e37c1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:59.860263 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-afee293e-8631-4cb6-891e-2dde9d1e37c1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:59.864488 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=22 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:59.869575 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-674e9143-a77e-42ab-a709-1c683ef2b603 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:01:59.870897 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-674e9143-a77e-42ab-a709-1c683ef2b603 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:01:59.877112 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-674e9143-a77e-42ab-a709-1c683ef2b603 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:59.877562 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-674e9143-a77e-42ab-a709-1c683ef2b603 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:59.878354 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-674e9143-a77e-42ab-a709-1c683ef2b603 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:01:59.878786 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-674e9143-a77e-42ab-a709-1c683ef2b603 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:01:59.997681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-afee293e-8631-4cb6-891e-2dde9d1e37c1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:00.005772 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-afee293e-8631-4cb6-891e-2dde9d1e37c1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:00.007572 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-afee293e-8631-4cb6-891e-2dde9d1e37c1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:00.012979 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-afee293e-8631-4cb6-891e-2dde9d1e37c1 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1742 microversion: 2.20 time: 0.161880 Jul 25 06:02:00.012979 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 196/378] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:01:59 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:00.014091 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-674e9143-a77e-42ab-a709-1c683ef2b603 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:00.016105 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0ac76b79-6990-430e-8ab3-9552a4a4163d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:00.016876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0ac76b79-6990-430e-8ab3-9552a4a4163d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:00.022911 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-674e9143-a77e-42ab-a709-1c683ef2b603 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.159253 Jul 25 06:02:00.023413 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 183/379] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:01:59 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:00.023543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ac76b79-6990-430e-8ab3-9552a4a4163d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:00.023857 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ac76b79-6990-430e-8ab3-9552a4a4163d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:00.024832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ac76b79-6990-430e-8ab3-9552a4a4163d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:00.025265 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ac76b79-6990-430e-8ab3-9552a4a4163d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:00.153249 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0ac76b79-6990-430e-8ab3-9552a4a4163d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:00.160752 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0ac76b79-6990-430e-8ab3-9552a4a4163d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.150520 Jul 25 06:02:00.161322 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 197/380] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:00 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:01.030608 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c9a6a4f9-0eaf-4d14-85e1-b05ac1d81a22 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:01.031282 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c9a6a4f9-0eaf-4d14-85e1-b05ac1d81a22 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:01.043013 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9a6a4f9-0eaf-4d14-85e1-b05ac1d81a22 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:01.043459 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9a6a4f9-0eaf-4d14-85e1-b05ac1d81a22 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:01.044334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9a6a4f9-0eaf-4d14-85e1-b05ac1d81a22 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:01.044791 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-48ab86d0-dc99-4347-b3d4-864cd3d67704 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:01.045306 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9a6a4f9-0eaf-4d14-85e1-b05ac1d81a22 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:01.047198 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-48ab86d0-dc99-4347-b3d4-864cd3d67704 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:01.057396 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48ab86d0-dc99-4347-b3d4-864cd3d67704 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:01.059313 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48ab86d0-dc99-4347-b3d4-864cd3d67704 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:01.061742 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48ab86d0-dc99-4347-b3d4-864cd3d67704 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:01.062785 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48ab86d0-dc99-4347-b3d4-864cd3d67704 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:01.204273 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c9a6a4f9-0eaf-4d14-85e1-b05ac1d81a22 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:01.212784 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c9a6a4f9-0eaf-4d14-85e1-b05ac1d81a22 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:01.214427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c9a6a4f9-0eaf-4d14-85e1-b05ac1d81a22 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:01.215837 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c9a6a4f9-0eaf-4d14-85e1-b05ac1d81a22 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1742 microversion: 2.20 time: 0.189271 Jul 25 06:02:01.216451 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 184/381] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:01 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1742 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:01.221072 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4091c075-30bf-43b7-b9ee-822ff8dfc3da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:01.221842 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4091c075-30bf-43b7-b9ee-822ff8dfc3da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:01.228994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4091c075-30bf-43b7-b9ee-822ff8dfc3da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:01.229104 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4091c075-30bf-43b7-b9ee-822ff8dfc3da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:01.229916 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4091c075-30bf-43b7-b9ee-822ff8dfc3da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:01.230249 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4091c075-30bf-43b7-b9ee-822ff8dfc3da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:01.381860 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4091c075-30bf-43b7-b9ee-822ff8dfc3da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:01.390307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4091c075-30bf-43b7-b9ee-822ff8dfc3da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.172774 Jul 25 06:02:01.390802 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 185/382] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:01 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:01.567763 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-48ab86d0-dc99-4347-b3d4-864cd3d67704 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:01.576437 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-48ab86d0-dc99-4347-b3d4-864cd3d67704 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.539366 Jul 25 06:02:01.577010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 198/383] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:01 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:01.864329 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5c4c0>>, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-386379839", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:01.920645 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.network.neutron [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] validate_networks() for None {{(pid=124918) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:02:02.236035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0e30b4df-a805-43ac-b788-ce5ebe77daaa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:02.237229 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0e30b4df-a805-43ac-b788-ce5ebe77daaa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:02.248639 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0e30b4df-a805-43ac-b788-ce5ebe77daaa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.249453 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0e30b4df-a805-43ac-b788-ce5ebe77daaa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.250373 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0e30b4df-a805-43ac-b788-ce5ebe77daaa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.250996 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0e30b4df-a805-43ac-b788-ce5ebe77daaa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.299562 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Flavor limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:02:02.300293 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Image limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:02:02.300770 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Flavor pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:02:02.301236 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Image pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:02:02.301648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:02:02.317972 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.318781 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.320254 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.320916 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.345031 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Getting quotas for project f0e6671f7e7e432b92deccdaf094fed4. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:02:02.349871 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Getting quotas for user ff863f4f7a2147239fb491097268c9e8 and project f0e6671f7e7e432b92deccdaf094fed4. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:02:02.364454 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Going to run 1 instances... {{(pid=124918) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:02:02.367444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:02:02.418074 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0e30b4df-a805-43ac-b788-ce5ebe77daaa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:02.429661 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0e30b4df-a805-43ac-b788-ce5ebe77daaa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:02.431491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0e30b4df-a805-43ac-b788-ce5ebe77daaa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:02.433307 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0e30b4df-a805-43ac-b788-ce5ebe77daaa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1737 microversion: 2.20 time: 0.202847 Jul 25 06:02:02.433864 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 199/384] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:02 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:02.439168 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9f5c24b5-4f8b-44e9-be9e-e6e3a5ed5c83 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:02.450564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9f5c24b5-4f8b-44e9-be9e-e6e3a5ed5c83 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:02.450564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9f5c24b5-4f8b-44e9-be9e-e6e3a5ed5c83 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.450564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9f5c24b5-4f8b-44e9-be9e-e6e3a5ed5c83 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.450564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9f5c24b5-4f8b-44e9-be9e-e6e3a5ed5c83 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.450885 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9f5c24b5-4f8b-44e9-be9e-e6e3a5ed5c83 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.503168 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e55543f7-a3c6-40c6-a54d-2148538d1e71 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643081 Jul 25 06:02:02.504149 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 186/385] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:02:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:02:02.515074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-40c00bf0-7269-422a-84a8-08fd36f06afd tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:02.516067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-40c00bf0-7269-422a-84a8-08fd36f06afd tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:02.596490 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-40c00bf0-7269-422a-84a8-08fd36f06afd tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:02.604496 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-40c00bf0-7269-422a-84a8-08fd36f06afd tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1214 microversion: 2.1 time: 0.092730 Jul 25 06:02:02.606307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 187/386] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:02 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:02.612572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-95eb2682-fb2b-4113-835b-5b42cda18b96 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:02.613183 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-95eb2682-fb2b-4113-835b-5b42cda18b96 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:02.617131 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9f5c24b5-4f8b-44e9-be9e-e6e3a5ed5c83 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:02.621788 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95eb2682-fb2b-4113-835b-5b42cda18b96 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.622328 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95eb2682-fb2b-4113-835b-5b42cda18b96 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.623038 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95eb2682-fb2b-4113-835b-5b42cda18b96 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:02.623478 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95eb2682-fb2b-4113-835b-5b42cda18b96 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:02.626530 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9f5c24b5-4f8b-44e9-be9e-e6e3a5ed5c83 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.191641 Jul 25 06:02:02.627646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 200/387] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:02 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:02.648948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=100 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:02.818184 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-95eb2682-fb2b-4113-835b-5b42cda18b96 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:02.986901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-95eb2682-fb2b-4113-835b-5b42cda18b96 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.220710 Jul 25 06:02:02.986901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 188/388] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:02 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:03.458219 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e2ca284c-e39f-4b3a-8949-8f69cb7ba77c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:03.464868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e2ca284c-e39f-4b3a-8949-8f69cb7ba77c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:03.466911 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e2ca284c-e39f-4b3a-8949-8f69cb7ba77c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:03.467546 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e2ca284c-e39f-4b3a-8949-8f69cb7ba77c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:03.468529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e2ca284c-e39f-4b3a-8949-8f69cb7ba77c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:03.468969 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e2ca284c-e39f-4b3a-8949-8f69cb7ba77c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:03.624520 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c1b15d4c-a22f-4cc4-ac82-87117579e044 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:03.626681 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c1b15d4c-a22f-4cc4-ac82-87117579e044 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:03.660549 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e2ca284c-e39f-4b3a-8949-8f69cb7ba77c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:03.674914 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e2ca284c-e39f-4b3a-8949-8f69cb7ba77c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:03.677527 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e2ca284c-e39f-4b3a-8949-8f69cb7ba77c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:03.677804 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e2ca284c-e39f-4b3a-8949-8f69cb7ba77c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1737 microversion: 2.20 time: 0.223498 Jul 25 06:02:03.678626 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 201/389] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:03 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:03.684710 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8145dfb0-63a3-4585-9273-53d0c30ef245 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:03.685749 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8145dfb0-63a3-4585-9273-53d0c30ef245 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:03.694004 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8145dfb0-63a3-4585-9273-53d0c30ef245 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:03.694863 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8145dfb0-63a3-4585-9273-53d0c30ef245 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:03.695944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8145dfb0-63a3-4585-9273-53d0c30ef245 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:03.696676 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8145dfb0-63a3-4585-9273-53d0c30ef245 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:03.723061 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:03.728079 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c1b15d4c-a22f-4cc4-ac82-87117579e044 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:03.758833 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c1b15d4c-a22f-4cc4-ac82-87117579e044 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1214 microversion: 2.1 time: 0.130304 Jul 25 06:02:03.758833 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 189/390] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:03 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:03.868866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8145dfb0-63a3-4585-9273-53d0c30ef245 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:03.877583 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8145dfb0-63a3-4585-9273-53d0c30ef245 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.197358 Jul 25 06:02:03.878600 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 202/391] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:03 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:03.993567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1f38aa81-be8b-4bb6-8200-7e96de7f7826 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:03.995271 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1f38aa81-be8b-4bb6-8200-7e96de7f7826 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:04.001912 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f38aa81-be8b-4bb6-8200-7e96de7f7826 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.002434 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f38aa81-be8b-4bb6-8200-7e96de7f7826 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.003201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f38aa81-be8b-4bb6-8200-7e96de7f7826 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.003632 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f38aa81-be8b-4bb6-8200-7e96de7f7826 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.174468 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1f38aa81-be8b-4bb6-8200-7e96de7f7826 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:04.184924 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1f38aa81-be8b-4bb6-8200-7e96de7f7826 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.195217 Jul 25 06:02:04.194531 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 190/392] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:03 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:04.705306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d2a1aa9a-eb8d-49da-a7a8-d6147c2fe9c6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:04.705986 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d2a1aa9a-eb8d-49da-a7a8-d6147c2fe9c6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:04.713969 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d2a1aa9a-eb8d-49da-a7a8-d6147c2fe9c6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.716746 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d2a1aa9a-eb8d-49da-a7a8-d6147c2fe9c6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.717799 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d2a1aa9a-eb8d-49da-a7a8-d6147c2fe9c6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.718233 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d2a1aa9a-eb8d-49da-a7a8-d6147c2fe9c6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.767492 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-77c34c20-c22a-4837-a067-38d9ed580b42 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:04.768092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-77c34c20-c22a-4837-a067-38d9ed580b42 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:04.775747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-77c34c20-c22a-4837-a067-38d9ed580b42 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.776345 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-77c34c20-c22a-4837-a067-38d9ed580b42 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.777181 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-77c34c20-c22a-4837-a067-38d9ed580b42 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.777749 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-77c34c20-c22a-4837-a067-38d9ed580b42 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.841748 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-77c34c20-c22a-4837-a067-38d9ed580b42 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:04.849321 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-77c34c20-c22a-4837-a067-38d9ed580b42 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1218 microversion: 2.1 time: 0.085766 Jul 25 06:02:04.849992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 191/393] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:04 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:04.862658 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d2a1aa9a-eb8d-49da-a7a8-d6147c2fe9c6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:04.871183 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d2a1aa9a-eb8d-49da-a7a8-d6147c2fe9c6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:04.872725 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d2a1aa9a-eb8d-49da-a7a8-d6147c2fe9c6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:04.873870 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d2a1aa9a-eb8d-49da-a7a8-d6147c2fe9c6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1737 microversion: 2.20 time: 0.179895 Jul 25 06:02:04.874421 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 203/394] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:04 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:04.895026 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e7733f10-6fd8-4bd5-a430-10f562ca7f27 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:04.895632 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e7733f10-6fd8-4bd5-a430-10f562ca7f27 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:04.901890 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e7733f10-6fd8-4bd5-a430-10f562ca7f27 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.902328 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e7733f10-6fd8-4bd5-a430-10f562ca7f27 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:04.903081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e7733f10-6fd8-4bd5-a430-10f562ca7f27 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:04.903512 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e7733f10-6fd8-4bd5-a430-10f562ca7f27 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.037874 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-e7733f10-6fd8-4bd5-a430-10f562ca7f27 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:05.049142 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e7733f10-6fd8-4bd5-a430-10f562ca7f27 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.158166 Jul 25 06:02:05.049701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 192/395] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:04 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:05.203307 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c0b2bce0-c577-4386-b1ca-60bad5e890d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:05.203724 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c0b2bce0-c577-4386-b1ca-60bad5e890d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:05.211810 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c0b2bce0-c577-4386-b1ca-60bad5e890d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.212244 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c0b2bce0-c577-4386-b1ca-60bad5e890d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.213812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c0b2bce0-c577-4386-b1ca-60bad5e890d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.214308 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c0b2bce0-c577-4386-b1ca-60bad5e890d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.360380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c0b2bce0-c577-4386-b1ca-60bad5e890d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:05.374676 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c0b2bce0-c577-4386-b1ca-60bad5e890d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1724 microversion: 2.1 time: 0.175432 Jul 25 06:02:05.379967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 204/396] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:05 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:05.866348 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5d5219c6-e829-463f-8240-cc00b0ba0e9c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:05.867059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5d5219c6-e829-463f-8240-cc00b0ba0e9c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:05.877680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d5219c6-e829-463f-8240-cc00b0ba0e9c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.878484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d5219c6-e829-463f-8240-cc00b0ba0e9c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.879486 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d5219c6-e829-463f-8240-cc00b0ba0e9c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.880008 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d5219c6-e829-463f-8240-cc00b0ba0e9c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.892393 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-442ebf5f-0044-48e4-8b81-284dd540e737 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:05.893095 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-442ebf5f-0044-48e4-8b81-284dd540e737 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:05.900995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-442ebf5f-0044-48e4-8b81-284dd540e737 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.901779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-442ebf5f-0044-48e4-8b81-284dd540e737 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.902869 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-442ebf5f-0044-48e4-8b81-284dd540e737 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:05.903554 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-442ebf5f-0044-48e4-8b81-284dd540e737 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:05.972613 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5d5219c6-e829-463f-8240-cc00b0ba0e9c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:05.983408 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5d5219c6-e829-463f-8240-cc00b0ba0e9c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1218 microversion: 2.1 time: 0.121080 Jul 25 06:02:05.984952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 193/397] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:05 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:06.072017 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-97951981-f000-48a9-b941-8c434e2262e1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:06.072882 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-97951981-f000-48a9-b941-8c434e2262e1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:06.082907 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-97951981-f000-48a9-b941-8c434e2262e1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.085233 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-97951981-f000-48a9-b941-8c434e2262e1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.087584 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-97951981-f000-48a9-b941-8c434e2262e1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.092094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-97951981-f000-48a9-b941-8c434e2262e1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.124788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-442ebf5f-0044-48e4-8b81-284dd540e737 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:06.149903 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-442ebf5f-0044-48e4-8b81-284dd540e737 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:06.153911 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-442ebf5f-0044-48e4-8b81-284dd540e737 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:06.158178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-442ebf5f-0044-48e4-8b81-284dd540e737 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1737 microversion: 2.20 time: 0.270012 Jul 25 06:02:06.160610 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 205/398] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:05 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1737 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:02:06.288592 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-97951981-f000-48a9-b941-8c434e2262e1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:06.298150 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-97951981-f000-48a9-b941-8c434e2262e1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.231177 Jul 25 06:02:06.302887 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 194/399] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:06 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:06.392261 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-34e6a611-0057-4b06-aa46-f39c50a0319a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:06.394899 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-34e6a611-0057-4b06-aa46-f39c50a0319a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:06.405727 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34e6a611-0057-4b06-aa46-f39c50a0319a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.406607 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34e6a611-0057-4b06-aa46-f39c50a0319a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.407940 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34e6a611-0057-4b06-aa46-f39c50a0319a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.408615 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34e6a611-0057-4b06-aa46-f39c50a0319a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.596736 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-34e6a611-0057-4b06-aa46-f39c50a0319a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:06.605484 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-34e6a611-0057-4b06-aa46-f39c50a0319a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1701 microversion: 2.1 time: 0.217192 Jul 25 06:02:06.606664 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 206/400] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:06 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1701 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:06.622921 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6021c36a-2cbb-4126-a93d-ccac826b4f52 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Action: 'action', calling method: <bound method ServersController._start_server of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f3c8b0>>, body: {"os-start": {}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:06.638162 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6021c36a-2cbb-4126-a93d-ccac826b4f52 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.638949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6021c36a-2cbb-4126-a93d-ccac826b4f52 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.723323 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6021c36a-2cbb-4126-a93d-ccac826b4f52 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Going to try to start instance {{(pid=124918) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 06:02:06.899456 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6021c36a-2cbb-4126-a93d-ccac826b4f52 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "POST /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/action" status: 202 len: 0 microversion: 2.1 time: 0.280388 Jul 25 06:02:06.900096 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 195/401] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:02:06 2022] POST /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:02:06.908710 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-cbf17b6c-cd22-41de-a0f5-891a79a1ef9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:06.909978 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cbf17b6c-cd22-41de-a0f5-891a79a1ef9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:06.918202 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cbf17b6c-cd22-41de-a0f5-891a79a1ef9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.918958 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cbf17b6c-cd22-41de-a0f5-891a79a1ef9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:06.919803 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cbf17b6c-cd22-41de-a0f5-891a79a1ef9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:06.920344 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cbf17b6c-cd22-41de-a0f5-891a79a1ef9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:07.002783 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-cb160abc-b99a-4e4e-bce5-51cca5b78228 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:07.003485 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-cb160abc-b99a-4e4e-bce5-51cca5b78228 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:07.016526 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cb160abc-b99a-4e4e-bce5-51cca5b78228 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:07.017004 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cb160abc-b99a-4e4e-bce5-51cca5b78228 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:07.017800 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cb160abc-b99a-4e4e-bce5-51cca5b78228 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:07.018231 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cb160abc-b99a-4e4e-bce5-51cca5b78228 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:07.081925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-cbf17b6c-cd22-41de-a0f5-891a79a1ef9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:07.087138 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cb160abc-b99a-4e4e-bce5-51cca5b78228 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:07.101947 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-cbf17b6c-cd22-41de-a0f5-891a79a1ef9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1710 microversion: 2.1 time: 0.187176 Jul 25 06:02:07.101947 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 207/402] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:06 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1710 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:07.102207 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-cb160abc-b99a-4e4e-bce5-51cca5b78228 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1266 microversion: 2.1 time: 0.097679 Jul 25 06:02:07.102207 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 196/403] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:06 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:07.179181 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-78329546-4de8-486e-a7fc-dba05c6b1cb0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:07.179796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-78329546-4de8-486e-a7fc-dba05c6b1cb0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:07.186899 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78329546-4de8-486e-a7fc-dba05c6b1cb0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:07.187375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78329546-4de8-486e-a7fc-dba05c6b1cb0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:07.188218 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78329546-4de8-486e-a7fc-dba05c6b1cb0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:07.188661 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78329546-4de8-486e-a7fc-dba05c6b1cb0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:07.316706 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-88949b8c-d813-418f-b6a5-13c251596b78 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:07.317384 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-88949b8c-d813-418f-b6a5-13c251596b78 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:07.324846 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-88949b8c-d813-418f-b6a5-13c251596b78 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:07.327848 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-88949b8c-d813-418f-b6a5-13c251596b78 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:07.327848 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-88949b8c-d813-418f-b6a5-13c251596b78 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:07.327848 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-88949b8c-d813-418f-b6a5-13c251596b78 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:07.350825 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-78329546-4de8-486e-a7fc-dba05c6b1cb0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:07.359872 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-78329546-4de8-486e-a7fc-dba05c6b1cb0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:07.361451 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-78329546-4de8-486e-a7fc-dba05c6b1cb0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:07.362693 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-78329546-4de8-486e-a7fc-dba05c6b1cb0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1737 microversion: 2.20 time: 0.187961 Jul 25 06:02:07.363202 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 208/404] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:07 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:07.480767 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-88949b8c-d813-418f-b6a5-13c251596b78 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:07.488407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-88949b8c-d813-418f-b6a5-13c251596b78 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.175737 Jul 25 06:02:07.489166 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 197/405] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:07 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:08.109243 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-41111bc4-7ea9-432c-ba10-30517a45ea75 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:08.110589 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-41111bc4-7ea9-432c-ba10-30517a45ea75 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:08.113248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c1cb500a-62dc-4a05-8d99-8222823451a8 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:08.113860 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c1cb500a-62dc-4a05-8d99-8222823451a8 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:08.118198 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-41111bc4-7ea9-432c-ba10-30517a45ea75 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.118868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-41111bc4-7ea9-432c-ba10-30517a45ea75 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.119861 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-41111bc4-7ea9-432c-ba10-30517a45ea75 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.120538 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-41111bc4-7ea9-432c-ba10-30517a45ea75 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.120801 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c1cb500a-62dc-4a05-8d99-8222823451a8 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.121554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c1cb500a-62dc-4a05-8d99-8222823451a8 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.122324 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c1cb500a-62dc-4a05-8d99-8222823451a8 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.122971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c1cb500a-62dc-4a05-8d99-8222823451a8 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.187502 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c1cb500a-62dc-4a05-8d99-8222823451a8 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:08.194962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c1cb500a-62dc-4a05-8d99-8222823451a8 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1266 microversion: 2.1 time: 0.086472 Jul 25 06:02:08.195533 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 198/406] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:08 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:08.256876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-41111bc4-7ea9-432c-ba10-30517a45ea75 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:08.265859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-41111bc4-7ea9-432c-ba10-30517a45ea75 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1710 microversion: 2.1 time: 0.160894 Jul 25 06:02:08.266423 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 209/407] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:08 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:08.381601 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1113fe29-3d0a-493b-8dad-dbf55c5a786c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:08.382150 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1113fe29-3d0a-493b-8dad-dbf55c5a786c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:08.389090 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1113fe29-3d0a-493b-8dad-dbf55c5a786c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.389533 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1113fe29-3d0a-493b-8dad-dbf55c5a786c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.390307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1113fe29-3d0a-493b-8dad-dbf55c5a786c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.390738 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1113fe29-3d0a-493b-8dad-dbf55c5a786c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.505594 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-08584398-c2a8-4857-9550-250e8495ecc1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:08.506196 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-08584398-c2a8-4857-9550-250e8495ecc1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:08.513526 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-08584398-c2a8-4857-9550-250e8495ecc1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.513969 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-08584398-c2a8-4857-9550-250e8495ecc1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.514725 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-08584398-c2a8-4857-9550-250e8495ecc1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:08.515153 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-08584398-c2a8-4857-9550-250e8495ecc1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:08.525023 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1113fe29-3d0a-493b-8dad-dbf55c5a786c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:08.533272 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1113fe29-3d0a-493b-8dad-dbf55c5a786c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:08.534809 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1113fe29-3d0a-493b-8dad-dbf55c5a786c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:08.535956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1113fe29-3d0a-493b-8dad-dbf55c5a786c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1737 microversion: 2.20 time: 0.158546 Jul 25 06:02:08.536635 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 199/408] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:08 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:08.657933 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-08584398-c2a8-4857-9550-250e8495ecc1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:08.662056 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-08584398-c2a8-4857-9550-250e8495ecc1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.160351 Jul 25 06:02:08.662702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 210/409] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:08 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:09.213837 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2f291e07-c144-4970-9d08-88a327555b6e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:09.214513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2f291e07-c144-4970-9d08-88a327555b6e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:09.221271 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f291e07-c144-4970-9d08-88a327555b6e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.221774 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f291e07-c144-4970-9d08-88a327555b6e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.223356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f291e07-c144-4970-9d08-88a327555b6e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.224087 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f291e07-c144-4970-9d08-88a327555b6e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.286093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e7a3ceee-bc1c-4621-b1c1-8fcd7bcca538 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:09.286807 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e7a3ceee-bc1c-4621-b1c1-8fcd7bcca538 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:09.301524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7a3ceee-bc1c-4621-b1c1-8fcd7bcca538 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.306186 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7a3ceee-bc1c-4621-b1c1-8fcd7bcca538 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.307780 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7a3ceee-bc1c-4621-b1c1-8fcd7bcca538 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.308245 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7a3ceee-bc1c-4621-b1c1-8fcd7bcca538 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.320172 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2f291e07-c144-4970-9d08-88a327555b6e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:09.328265 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2f291e07-c144-4970-9d08-88a327555b6e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1274 microversion: 2.1 time: 0.118242 Jul 25 06:02:09.333167 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 200/410] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:09 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:09.459996 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e7a3ceee-bc1c-4621-b1c1-8fcd7bcca538 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:09.469376 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e7a3ceee-bc1c-4621-b1c1-8fcd7bcca538 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1710 microversion: 2.1 time: 0.186996 Jul 25 06:02:09.469870 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 211/411] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:09 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1710 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:09.558584 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-75baf5f1-3fef-43be-9fc3-f72b53803154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:09.559205 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-75baf5f1-3fef-43be-9fc3-f72b53803154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:09.565383 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-75baf5f1-3fef-43be-9fc3-f72b53803154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.565831 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-75baf5f1-3fef-43be-9fc3-f72b53803154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.566586 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-75baf5f1-3fef-43be-9fc3-f72b53803154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.567025 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-75baf5f1-3fef-43be-9fc3-f72b53803154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.684435 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-84184129-99bb-4212-8c59-380100f2b582 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:09.684435 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-84184129-99bb-4212-8c59-380100f2b582 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:09.697492 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-84184129-99bb-4212-8c59-380100f2b582 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.698047 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-84184129-99bb-4212-8c59-380100f2b582 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.698941 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-84184129-99bb-4212-8c59-380100f2b582 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:09.699450 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-84184129-99bb-4212-8c59-380100f2b582 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:09.725339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-75baf5f1-3fef-43be-9fc3-f72b53803154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:09.739251 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-75baf5f1-3fef-43be-9fc3-f72b53803154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:09.740884 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-75baf5f1-3fef-43be-9fc3-f72b53803154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:09.741934 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-75baf5f1-3fef-43be-9fc3-f72b53803154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1737 microversion: 2.20 time: 0.187305 Jul 25 06:02:09.744170 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 201/412] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:09 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:10.016540 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-84184129-99bb-4212-8c59-380100f2b582 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:10.028100 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-84184129-99bb-4212-8c59-380100f2b582 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.352098 Jul 25 06:02:10.029132 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 212/413] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:09 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:10.367691 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-dffe9c78-4ee7-4cad-9933-739859357c0d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:10.370806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-dffe9c78-4ee7-4cad-9933-739859357c0d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:10.376935 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:10.394543 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dffe9c78-4ee7-4cad-9933-739859357c0d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.396877 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dffe9c78-4ee7-4cad-9933-739859357c0d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.397874 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dffe9c78-4ee7-4cad-9933-739859357c0d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.404911 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dffe9c78-4ee7-4cad-9933-739859357c0d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.487473 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b426f550-2d63-4626-81e7-a69c61e97a82 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:10.488353 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b426f550-2d63-4626-81e7-a69c61e97a82 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:10.504508 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b426f550-2d63-4626-81e7-a69c61e97a82 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.507535 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b426f550-2d63-4626-81e7-a69c61e97a82 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.508417 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b426f550-2d63-4626-81e7-a69c61e97a82 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.508871 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b426f550-2d63-4626-81e7-a69c61e97a82 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.636997 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-dffe9c78-4ee7-4cad-9933-739859357c0d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:10.647363 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-dffe9c78-4ee7-4cad-9933-739859357c0d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1284 microversion: 2.1 time: 0.300997 Jul 25 06:02:10.648148 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 202/414] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:10 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:10.761171 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7bc3f0e1-f797-4ea0-8076-be778d536033 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:10.761782 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7bc3f0e1-f797-4ea0-8076-be778d536033 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:10.771336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bc3f0e1-f797-4ea0-8076-be778d536033 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.771794 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bc3f0e1-f797-4ea0-8076-be778d536033 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.773165 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bc3f0e1-f797-4ea0-8076-be778d536033 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:10.773165 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bc3f0e1-f797-4ea0-8076-be778d536033 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:10.790463 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b426f550-2d63-4626-81e7-a69c61e97a82 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:10.799562 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b426f550-2d63-4626-81e7-a69c61e97a82 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1710 microversion: 2.1 time: 0.316291 Jul 25 06:02:10.803649 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 213/415] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:10 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1710 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:10.952874 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7bc3f0e1-f797-4ea0-8076-be778d536033 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:10.963307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7bc3f0e1-f797-4ea0-8076-be778d536033 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:10.964855 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7bc3f0e1-f797-4ea0-8076-be778d536033 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:10.966102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7bc3f0e1-f797-4ea0-8076-be778d536033 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1737 microversion: 2.20 time: 0.209682 Jul 25 06:02:10.966849 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 203/416] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:10 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:11.046484 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d9c47068-25be-4de5-9ba1-c9d913fed159 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:11.047013 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d9c47068-25be-4de5-9ba1-c9d913fed159 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:11.055128 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d9c47068-25be-4de5-9ba1-c9d913fed159 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.058089 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d9c47068-25be-4de5-9ba1-c9d913fed159 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.058089 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d9c47068-25be-4de5-9ba1-c9d913fed159 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.058089 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d9c47068-25be-4de5-9ba1-c9d913fed159 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.222040 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d9c47068-25be-4de5-9ba1-c9d913fed159 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:11.231301 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d9c47068-25be-4de5-9ba1-c9d913fed159 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.189063 Jul 25 06:02:11.232178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 214/417] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:11 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:11.670038 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3eff045c-3f8f-466e-befe-6815e65f2fc1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:11.670732 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3eff045c-3f8f-466e-befe-6815e65f2fc1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:11.677764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3eff045c-3f8f-466e-befe-6815e65f2fc1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.678220 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3eff045c-3f8f-466e-befe-6815e65f2fc1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.679012 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3eff045c-3f8f-466e-befe-6815e65f2fc1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.679635 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3eff045c-3f8f-466e-befe-6815e65f2fc1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.822762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-028d9899-c91b-4b7f-8946-7b1293265d9d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:11.823588 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-028d9899-c91b-4b7f-8946-7b1293265d9d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:11.847863 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-028d9899-c91b-4b7f-8946-7b1293265d9d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.848428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-028d9899-c91b-4b7f-8946-7b1293265d9d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.849519 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-028d9899-c91b-4b7f-8946-7b1293265d9d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.850053 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-028d9899-c91b-4b7f-8946-7b1293265d9d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.854547 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3eff045c-3f8f-466e-befe-6815e65f2fc1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:11.858080 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:11.862542 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3eff045c-3f8f-466e-befe-6815e65f2fc1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.199780 Jul 25 06:02:11.863135 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 204/418] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:11 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:11.987006 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a8e9f7cf-1f85-4211-be91-9b70f87fd5a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:11.987615 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a8e9f7cf-1f85-4211-be91-9b70f87fd5a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:11.995442 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a8e9f7cf-1f85-4211-be91-9b70f87fd5a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.996147 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a8e9f7cf-1f85-4211-be91-9b70f87fd5a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:11.996903 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a8e9f7cf-1f85-4211-be91-9b70f87fd5a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:11.997490 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a8e9f7cf-1f85-4211-be91-9b70f87fd5a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:12.121547 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-028d9899-c91b-4b7f-8946-7b1293265d9d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:12.132784 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-028d9899-c91b-4b7f-8946-7b1293265d9d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1710 microversion: 2.1 time: 0.315842 Jul 25 06:02:12.133679 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 215/419] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:11 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1710 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:12.149974 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a8e9f7cf-1f85-4211-be91-9b70f87fd5a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:12.158962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a8e9f7cf-1f85-4211-be91-9b70f87fd5a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:12.160504 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a8e9f7cf-1f85-4211-be91-9b70f87fd5a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:12.161695 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a8e9f7cf-1f85-4211-be91-9b70f87fd5a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1737 microversion: 2.20 time: 0.180988 Jul 25 06:02:12.162253 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 205/420] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:11 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:02:12.248874 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-02e53b73-f684-4835-a069-6de3409630b3 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:12.249518 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-02e53b73-f684-4835-a069-6de3409630b3 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:12.255473 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02e53b73-f684-4835-a069-6de3409630b3 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:12.255919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02e53b73-f684-4835-a069-6de3409630b3 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:12.256701 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02e53b73-f684-4835-a069-6de3409630b3 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:12.257134 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02e53b73-f684-4835-a069-6de3409630b3 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:12.406897 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-02e53b73-f684-4835-a069-6de3409630b3 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:12.414291 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-02e53b73-f684-4835-a069-6de3409630b3 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.169433 Jul 25 06:02:12.414843 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 216/421] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:12 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:12.713086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-6a230933-cdd9-48f2-aa69-559400222b93 req-18b52b9a-8290-4268-bb5c-741982dd3651 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "7c1d7240-ffe0-424b-aa2c-f44036123979", "name": "network-vif-plugged", "status": "completed", "tag": "76c263b9-b74b-41c2-b7e7-d3f293d10eea"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:12.723535 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:12.727208 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-6a230933-cdd9-48f2-aa69-559400222b93 req-18b52b9a-8290-4268-bb5c-741982dd3651 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:12.728990 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-6a230933-cdd9-48f2-aa69-559400222b93 req-18b52b9a-8290-4268-bb5c-741982dd3651 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:12.745591 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-6a230933-cdd9-48f2-aa69-559400222b93 req-18b52b9a-8290-4268-bb5c-741982dd3651 service nova] Creating event network-vif-plugged:76c263b9-b74b-41c2-b7e7-d3f293d10eea for instance 7c1d7240-ffe0-424b-aa2c-f44036123979 on hv-cinder-84841 Jul 25 06:02:12.756901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-6a230933-cdd9-48f2-aa69-559400222b93 req-18b52b9a-8290-4268-bb5c-741982dd3651 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049650 Jul 25 06:02:12.758664 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 206/422] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:12.883419 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d76b690d-a1dd-4248-b286-feff42400c65 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:12.884769 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d76b690d-a1dd-4248-b286-feff42400c65 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:12.910067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d76b690d-a1dd-4248-b286-feff42400c65 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:12.910812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d76b690d-a1dd-4248-b286-feff42400c65 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:12.911756 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d76b690d-a1dd-4248-b286-feff42400c65 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:12.912297 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d76b690d-a1dd-4248-b286-feff42400c65 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.104957 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-113dc5ad-5383-4110-a774-6e15551c705e req-85a38212-be78-4167-8e7a-20660b967f2b service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "b0f37573-28da-4e81-9d33-c762d63aaa0d", "tag": "c0702395-fb33-483b-89f6-9a4217997999"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:13.154714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-113dc5ad-5383-4110-a774-6e15551c705e req-85a38212-be78-4167-8e7a-20660b967f2b service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.156649 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-113dc5ad-5383-4110-a774-6e15551c705e req-85a38212-be78-4167-8e7a-20660b967f2b service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.170311 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-113dc5ad-5383-4110-a774-6e15551c705e req-85a38212-be78-4167-8e7a-20660b967f2b service nova] Creating event network-changed:c0702395-fb33-483b-89f6-9a4217997999 for instance b0f37573-28da-4e81-9d33-c762d63aaa0d on hv-cinder-84841 Jul 25 06:02:13.177988 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-113dc5ad-5383-4110-a774-6e15551c705e req-85a38212-be78-4167-8e7a-20660b967f2b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083911 Jul 25 06:02:13.179122 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 207/423] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:13.190245 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b0535e14-cb7c-41e6-a2c6-78cdcabf659b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:13.194553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b0535e14-cb7c-41e6-a2c6-78cdcabf659b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:13.201020 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d76b690d-a1dd-4248-b286-feff42400c65 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:13.203363 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b0535e14-cb7c-41e6-a2c6-78cdcabf659b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.205473 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b0535e14-cb7c-41e6-a2c6-78cdcabf659b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.206236 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b0535e14-cb7c-41e6-a2c6-78cdcabf659b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.207369 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b0535e14-cb7c-41e6-a2c6-78cdcabf659b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.210492 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d76b690d-a1dd-4248-b286-feff42400c65 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.332974 Jul 25 06:02:13.211064 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 217/424] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:12 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:13.233727 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-48e341e9-6c66-410b-a840-1cf9d97f2bde tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:13.237528 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-48e341e9-6c66-410b-a840-1cf9d97f2bde tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:13.261006 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48e341e9-6c66-410b-a840-1cf9d97f2bde tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.261707 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48e341e9-6c66-410b-a840-1cf9d97f2bde tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.262632 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48e341e9-6c66-410b-a840-1cf9d97f2bde tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.263211 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48e341e9-6c66-410b-a840-1cf9d97f2bde tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.455556 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b0535e14-cb7c-41e6-a2c6-78cdcabf659b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:13.466762 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b0535e14-cb7c-41e6-a2c6-78cdcabf659b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1714 microversion: 2.1 time: 0.286172 Jul 25 06:02:13.467946 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 208/425] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:13 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1714 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:13.472673 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-58dea3f5-d150-4f40-94d9-29b8cf7ab656 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:13.473493 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-58dea3f5-d150-4f40-94d9-29b8cf7ab656 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:13.480208 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-58dea3f5-d150-4f40-94d9-29b8cf7ab656 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.480925 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-58dea3f5-d150-4f40-94d9-29b8cf7ab656 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.481863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-58dea3f5-d150-4f40-94d9-29b8cf7ab656 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:13.482442 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-58dea3f5-d150-4f40-94d9-29b8cf7ab656 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:13.484864 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-48e341e9-6c66-410b-a840-1cf9d97f2bde tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:13.494466 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-48e341e9-6c66-410b-a840-1cf9d97f2bde tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:13.496405 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-48e341e9-6c66-410b-a840-1cf9d97f2bde tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:13.497694 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-48e341e9-6c66-410b-a840-1cf9d97f2bde tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1737 microversion: 2.20 time: 0.280223 Jul 25 06:02:13.498573 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 218/426] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:13 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1737 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:13.662722 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-58dea3f5-d150-4f40-94d9-29b8cf7ab656 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:13.671987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-58dea3f5-d150-4f40-94d9-29b8cf7ab656 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.202874 Jul 25 06:02:13.672614 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 209/427] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:13 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:14.228449 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-628cfb45-bb8b-4f16-90ea-929ef0d863bc tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:14.229053 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-628cfb45-bb8b-4f16-90ea-929ef0d863bc tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:14.235230 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-628cfb45-bb8b-4f16-90ea-929ef0d863bc tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.235700 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-628cfb45-bb8b-4f16-90ea-929ef0d863bc tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.236497 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-628cfb45-bb8b-4f16-90ea-929ef0d863bc tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.236932 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-628cfb45-bb8b-4f16-90ea-929ef0d863bc tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.240922 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:14.367317 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-628cfb45-bb8b-4f16-90ea-929ef0d863bc tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:14.375173 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-628cfb45-bb8b-4f16-90ea-929ef0d863bc tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.151151 Jul 25 06:02:14.375745 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 219/428] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:14 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:14.516630 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6d6d6b31-3fcb-40db-8388-1879585a76bc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:14.517182 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6d6d6b31-3fcb-40db-8388-1879585a76bc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:14.519791 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=10 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:14.524630 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6d6d6b31-3fcb-40db-8388-1879585a76bc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.525072 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6d6d6b31-3fcb-40db-8388-1879585a76bc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.525835 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6d6d6b31-3fcb-40db-8388-1879585a76bc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.526262 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6d6d6b31-3fcb-40db-8388-1879585a76bc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.659146 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6d6d6b31-3fcb-40db-8388-1879585a76bc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:14.667224 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6d6d6b31-3fcb-40db-8388-1879585a76bc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:14.668789 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6d6d6b31-3fcb-40db-8388-1879585a76bc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:14.669939 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6d6d6b31-3fcb-40db-8388-1879585a76bc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1737 microversion: 2.20 time: 0.157356 Jul 25 06:02:14.670501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 210/429] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:14 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:14.689437 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b0114855-8bfe-4c68-bfac-843210721795 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:14.690041 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b0114855-8bfe-4c68-bfac-843210721795 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:14.696134 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b0114855-8bfe-4c68-bfac-843210721795 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.696703 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b0114855-8bfe-4c68-bfac-843210721795 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.697390 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b0114855-8bfe-4c68-bfac-843210721795 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.697814 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b0114855-8bfe-4c68-bfac-843210721795 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.825361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b0114855-8bfe-4c68-bfac-843210721795 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:14.832986 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b0114855-8bfe-4c68-bfac-843210721795 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1313 microversion: 2.1 time: 0.147749 Jul 25 06:02:14.833562 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 220/430] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:14 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:14.853562 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5b80de85-1327-49b9-89cf-4f59d38fb606 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4850>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:14.854232 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5b80de85-1327-49b9-89cf-4f59d38fb606 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:14.860211 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b80de85-1327-49b9-89cf-4f59d38fb606 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.860664 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b80de85-1327-49b9-89cf-4f59d38fb606 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.861427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b80de85-1327-49b9-89cf-4f59d38fb606 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:14.861866 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b80de85-1327-49b9-89cf-4f59d38fb606 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:14.987967 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-5b80de85-1327-49b9-89cf-4f59d38fb606 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lazy-loading 'services' on Instance uuid 2abbf803-6310-4fcd-bc09-ff506fab0a30 {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:02:15.283258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5b80de85-1327-49b9-89cf-4f59d38fb606 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30/os-volume_attachments/d775896b-ce05-4a6c-bf47-e82b7aa6eed7" status: 202 len: 0 microversion: 2.1 time: 0.433928 Jul 25 06:02:15.283863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 211/431] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:02:14 2022] DELETE /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30/os-volume_attachments/d775896b-ce05-4a6c-bf47-e82b7aa6eed7 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:02:15.392439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0d8a2a04-3112-4146-a872-2eb589f0046e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:15.393074 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0d8a2a04-3112-4146-a872-2eb589f0046e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:15.399888 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d8a2a04-3112-4146-a872-2eb589f0046e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.400397 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d8a2a04-3112-4146-a872-2eb589f0046e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:15.401156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d8a2a04-3112-4146-a872-2eb589f0046e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.401590 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d8a2a04-3112-4146-a872-2eb589f0046e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:15.531450 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0d8a2a04-3112-4146-a872-2eb589f0046e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:15.539104 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0d8a2a04-3112-4146-a872-2eb589f0046e tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.150561 Jul 25 06:02:15.539671 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 221/432] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:15 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:15.689165 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b96b3e8c-b243-426a-8655-671aca2132a5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:15.689862 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b96b3e8c-b243-426a-8655-671aca2132a5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:15.696281 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b96b3e8c-b243-426a-8655-671aca2132a5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.697226 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b96b3e8c-b243-426a-8655-671aca2132a5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:15.697989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b96b3e8c-b243-426a-8655-671aca2132a5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.698442 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b96b3e8c-b243-426a-8655-671aca2132a5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:15.830284 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b96b3e8c-b243-426a-8655-671aca2132a5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:15.838790 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b96b3e8c-b243-426a-8655-671aca2132a5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:15.840341 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b96b3e8c-b243-426a-8655-671aca2132a5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:15.841494 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b96b3e8c-b243-426a-8655-671aca2132a5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1719 microversion: 2.20 time: 0.157092 Jul 25 06:02:15.842063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 212/433] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:15 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:15.849936 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-cebc2758-d325-4785-8cea-e691ff49c5fa tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:15.850543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cebc2758-d325-4785-8cea-e691ff49c5fa tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:15.856918 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cebc2758-d325-4785-8cea-e691ff49c5fa tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.857370 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cebc2758-d325-4785-8cea-e691ff49c5fa tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:15.858136 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cebc2758-d325-4785-8cea-e691ff49c5fa tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:15.858571 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cebc2758-d325-4785-8cea-e691ff49c5fa tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:15.987230 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-cebc2758-d325-4785-8cea-e691ff49c5fa tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:15.994671 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-cebc2758-d325-4785-8cea-e691ff49c5fa tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1496 microversion: 2.1 time: 0.148817 Jul 25 06:02:15.995174 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 222/434] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:15 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1496 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:16.559489 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ef0aeb51-1cab-4bea-86e7-96627411260d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:16.560105 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ef0aeb51-1cab-4bea-86e7-96627411260d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:16.566651 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ef0aeb51-1cab-4bea-86e7-96627411260d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:16.567100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ef0aeb51-1cab-4bea-86e7-96627411260d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:16.567856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ef0aeb51-1cab-4bea-86e7-96627411260d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:16.568330 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ef0aeb51-1cab-4bea-86e7-96627411260d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:16.703028 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ef0aeb51-1cab-4bea-86e7-96627411260d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:16.710365 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ef0aeb51-1cab-4bea-86e7-96627411260d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.155514 Jul 25 06:02:16.710923 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 213/435] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:16 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:16.860238 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6cff8898-e355-4c31-a1ba-c4128692da1a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:16.860935 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6cff8898-e355-4c31-a1ba-c4128692da1a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:16.867457 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cff8898-e355-4c31-a1ba-c4128692da1a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:16.867903 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cff8898-e355-4c31-a1ba-c4128692da1a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:16.869294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cff8898-e355-4c31-a1ba-c4128692da1a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:16.869784 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cff8898-e355-4c31-a1ba-c4128692da1a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:16.903377 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b86b7f8b-a2e6-4ba4-9f81-d5805d7ae0a9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:16.903867 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b86b7f8b-a2e6-4ba4-9f81-d5805d7ae0a9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:16.910017 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b86b7f8b-a2e6-4ba4-9f81-d5805d7ae0a9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:16.910452 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b86b7f8b-a2e6-4ba4-9f81-d5805d7ae0a9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:16.911367 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b86b7f8b-a2e6-4ba4-9f81-d5805d7ae0a9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:16.911799 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b86b7f8b-a2e6-4ba4-9f81-d5805d7ae0a9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:16.938211 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b86b7f8b-a2e6-4ba4-9f81-d5805d7ae0a9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:02:17.003569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6cff8898-e355-4c31-a1ba-c4128692da1a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:17.012142 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6cff8898-e355-4c31-a1ba-c4128692da1a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:17.013674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6cff8898-e355-4c31-a1ba-c4128692da1a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:17.014940 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6cff8898-e355-4c31-a1ba-c4128692da1a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1719 microversion: 2.20 time: 0.158728 Jul 25 06:02:17.015584 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 223/436] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:16 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:17.244105 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b86b7f8b-a2e6-4ba4-9f81-d5805d7ae0a9 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 204 len: 0 microversion: 2.1 time: 0.344421 Jul 25 06:02:17.244721 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 214/437] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:02:16 2022] DELETE /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 06:02:17.252724 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-09de83ee-72ae-405f-94cf-50d47e7be68d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:17.253359 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-09de83ee-72ae-405f-94cf-50d47e7be68d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:17.259881 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-09de83ee-72ae-405f-94cf-50d47e7be68d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:17.260356 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-09de83ee-72ae-405f-94cf-50d47e7be68d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:17.261111 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-09de83ee-72ae-405f-94cf-50d47e7be68d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:17.261547 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-09de83ee-72ae-405f-94cf-50d47e7be68d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:17.455764 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-09de83ee-72ae-405f-94cf-50d47e7be68d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:17.463363 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-09de83ee-72ae-405f-94cf-50d47e7be68d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1502 microversion: 2.1 time: 0.214326 Jul 25 06:02:17.463936 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 224/438] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:17 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:17.728611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-bb9d55e6-b378-40dc-9893-87b2b6bbf92b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:17.729319 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-bb9d55e6-b378-40dc-9893-87b2b6bbf92b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:17.735873 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bb9d55e6-b378-40dc-9893-87b2b6bbf92b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:17.736359 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bb9d55e6-b378-40dc-9893-87b2b6bbf92b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:17.737118 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bb9d55e6-b378-40dc-9893-87b2b6bbf92b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:17.737555 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bb9d55e6-b378-40dc-9893-87b2b6bbf92b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:17.869939 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-bb9d55e6-b378-40dc-9893-87b2b6bbf92b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:17.877423 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-bb9d55e6-b378-40dc-9893-87b2b6bbf92b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.153124 Jul 25 06:02:17.877986 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 215/439] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:17 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:18.033002 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d08aad68-1fa1-4e86-a537-ac5100b438b7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:18.033528 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d08aad68-1fa1-4e86-a537-ac5100b438b7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:18.039966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d08aad68-1fa1-4e86-a537-ac5100b438b7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.041146 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d08aad68-1fa1-4e86-a537-ac5100b438b7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:18.042122 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d08aad68-1fa1-4e86-a537-ac5100b438b7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.042554 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d08aad68-1fa1-4e86-a537-ac5100b438b7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:18.169758 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d08aad68-1fa1-4e86-a537-ac5100b438b7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:18.177538 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d08aad68-1fa1-4e86-a537-ac5100b438b7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:18.179040 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d08aad68-1fa1-4e86-a537-ac5100b438b7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:18.180204 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d08aad68-1fa1-4e86-a537-ac5100b438b7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1719 microversion: 2.20 time: 0.151181 Jul 25 06:02:18.181300 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 225/440] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:18 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:18.481085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5615b6ca-a389-4ee9-966d-ea7875131ca8 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:18.482672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5615b6ca-a389-4ee9-966d-ea7875131ca8 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:18.489618 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5615b6ca-a389-4ee9-966d-ea7875131ca8 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.490087 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5615b6ca-a389-4ee9-966d-ea7875131ca8 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:18.490860 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5615b6ca-a389-4ee9-966d-ea7875131ca8 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.491317 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5615b6ca-a389-4ee9-966d-ea7875131ca8 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:18.592849 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-1c704f8b-fffa-4c39-a9a9-ebf80575675e req-b4eb3dd4-5c2c-456b-9198-0f9d35e4d6c8 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "b2dc5c54-08fc-4392-a4b9-f1970578ffb7", "name": "network-vif-unplugged", "status": "completed", "tag": "c86fe1cd-ba90-483f-8c21-3093b1ee753e"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:18.601694 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-1c704f8b-fffa-4c39-a9a9-ebf80575675e req-b4eb3dd4-5c2c-456b-9198-0f9d35e4d6c8 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.602129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-1c704f8b-fffa-4c39-a9a9-ebf80575675e req-b4eb3dd4-5c2c-456b-9198-0f9d35e4d6c8 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:18.613827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-1c704f8b-fffa-4c39-a9a9-ebf80575675e req-b4eb3dd4-5c2c-456b-9198-0f9d35e4d6c8 service nova] Creating event network-vif-unplugged:c86fe1cd-ba90-483f-8c21-3093b1ee753e for instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 on hv-cinder-84841 Jul 25 06:02:18.619695 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-1c704f8b-fffa-4c39-a9a9-ebf80575675e req-b4eb3dd4-5c2c-456b-9198-0f9d35e4d6c8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031515 Jul 25 06:02:18.620498 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 226/441] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:18.634021 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5615b6ca-a389-4ee9-966d-ea7875131ca8 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:18.638464 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5615b6ca-a389-4ee9-966d-ea7875131ca8 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1502 microversion: 2.1 time: 0.161768 Jul 25 06:02:18.639127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 216/442] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:18 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:18.895062 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-444aa869-682a-4646-8774-bd4e85bdb62d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:18.895719 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-444aa869-682a-4646-8774-bd4e85bdb62d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:18.902129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-444aa869-682a-4646-8774-bd4e85bdb62d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.902567 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-444aa869-682a-4646-8774-bd4e85bdb62d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:18.903316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-444aa869-682a-4646-8774-bd4e85bdb62d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:18.903743 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-444aa869-682a-4646-8774-bd4e85bdb62d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:19.036357 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-444aa869-682a-4646-8774-bd4e85bdb62d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:19.045375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-444aa869-682a-4646-8774-bd4e85bdb62d tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.154873 Jul 25 06:02:19.045937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 227/443] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:18 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:19.198828 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ff9840f0-a063-416c-97a8-3819c7638a35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:19.199435 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ff9840f0-a063-416c-97a8-3819c7638a35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:19.205911 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ff9840f0-a063-416c-97a8-3819c7638a35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:19.206356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ff9840f0-a063-416c-97a8-3819c7638a35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:19.207109 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ff9840f0-a063-416c-97a8-3819c7638a35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:19.207542 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ff9840f0-a063-416c-97a8-3819c7638a35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:19.337832 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ff9840f0-a063-416c-97a8-3819c7638a35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:19.346036 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ff9840f0-a063-416c-97a8-3819c7638a35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:19.347535 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ff9840f0-a063-416c-97a8-3819c7638a35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:19.348692 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ff9840f0-a063-416c-97a8-3819c7638a35 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1719 microversion: 2.20 time: 0.153900 Jul 25 06:02:19.349243 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 217/444] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:19 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:19.656628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e326c3b6-aa0f-4489-9773-c593296bdfdc tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:19.657259 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e326c3b6-aa0f-4489-9773-c593296bdfdc tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:19.663474 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e326c3b6-aa0f-4489-9773-c593296bdfdc tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:19.663921 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e326c3b6-aa0f-4489-9773-c593296bdfdc tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:19.664747 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e326c3b6-aa0f-4489-9773-c593296bdfdc tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:19.665650 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e326c3b6-aa0f-4489-9773-c593296bdfdc tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.024150 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e326c3b6-aa0f-4489-9773-c593296bdfdc tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:20.032612 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e326c3b6-aa0f-4489-9773-c593296bdfdc tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1502 microversion: 2.1 time: 0.379771 Jul 25 06:02:20.033917 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 228/445] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:19 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1502 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:20.062642 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-df6cf6f7-8736-466d-8814-57715133a9db tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:20.063624 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-df6cf6f7-8736-466d-8814-57715133a9db tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:20.070534 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-df6cf6f7-8736-466d-8814-57715133a9db tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.070987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-df6cf6f7-8736-466d-8814-57715133a9db tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.071862 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-df6cf6f7-8736-466d-8814-57715133a9db tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.072332 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-df6cf6f7-8736-466d-8814-57715133a9db tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.296074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-df6cf6f7-8736-466d-8814-57715133a9db tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:20.305519 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-df6cf6f7-8736-466d-8814-57715133a9db tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.246746 Jul 25 06:02:20.307202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 218/446] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:20 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:20.367082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b50d4e93-7b2c-4ce8-bd8d-e29e30ac8df9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:20.368423 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b50d4e93-7b2c-4ce8-bd8d-e29e30ac8df9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:20.374962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b50d4e93-7b2c-4ce8-bd8d-e29e30ac8df9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.375419 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b50d4e93-7b2c-4ce8-bd8d-e29e30ac8df9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.376230 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b50d4e93-7b2c-4ce8-bd8d-e29e30ac8df9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.376668 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b50d4e93-7b2c-4ce8-bd8d-e29e30ac8df9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.626862 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-edb18563-1571-4a02-90ec-e4e754cca094 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:20.633009 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-edb18563-1571-4a02-90ec-e4e754cca094 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:20.634604 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-edb18563-1571-4a02-90ec-e4e754cca094 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.634778 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-edb18563-1571-4a02-90ec-e4e754cca094 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.635473 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-edb18563-1571-4a02-90ec-e4e754cca094 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.635908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-edb18563-1571-4a02-90ec-e4e754cca094 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.644974 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b50d4e93-7b2c-4ce8-bd8d-e29e30ac8df9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:20.653761 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b50d4e93-7b2c-4ce8-bd8d-e29e30ac8df9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:20.655368 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b50d4e93-7b2c-4ce8-bd8d-e29e30ac8df9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:20.656661 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b50d4e93-7b2c-4ce8-bd8d-e29e30ac8df9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1719 microversion: 2.20 time: 0.293730 Jul 25 06:02:20.664016 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-edb18563-1571-4a02-90ec-e4e754cca094 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:02:20.668106 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 229/447] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:20 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1719 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:20.672857 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-fcd10683-2de0-4592-b2d0-278b751fb0ad req-678d9393-abae-4678-94c7-36ffb777f59c service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "b0f37573-28da-4e81-9d33-c762d63aaa0d", "name": "network-vif-plugged", "status": "completed", "tag": "c0702395-fb33-483b-89f6-9a4217997999"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:20.681752 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-fcd10683-2de0-4592-b2d0-278b751fb0ad req-678d9393-abae-4678-94c7-36ffb777f59c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.682435 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-fcd10683-2de0-4592-b2d0-278b751fb0ad req-678d9393-abae-4678-94c7-36ffb777f59c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.691649 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:20.695366 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-fcd10683-2de0-4592-b2d0-278b751fb0ad req-678d9393-abae-4678-94c7-36ffb777f59c service nova] Creating event network-vif-plugged:c0702395-fb33-483b-89f6-9a4217997999 for instance b0f37573-28da-4e81-9d33-c762d63aaa0d on hv-cinder-84841 Jul 25 06:02:20.701352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-fcd10683-2de0-4592-b2d0-278b751fb0ad req-678d9393-abae-4678-94c7-36ffb777f59c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031945 Jul 25 06:02:20.706017 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 230/448] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:20.909345 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-467fc3d1-ace6-4716-8a1e-79cf093d2c08 req-6d310df8-a796-4d53-a3af-53aa9f98117d service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "7c1d7240-ffe0-424b-aa2c-f44036123979", "name": "network-vif-deleted", "tag": "76c263b9-b74b-41c2-b7e7-d3f293d10eea"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:20.918407 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-467fc3d1-ace6-4716-8a1e-79cf093d2c08 req-6d310df8-a796-4d53-a3af-53aa9f98117d service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.918827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-467fc3d1-ace6-4716-8a1e-79cf093d2c08 req-6d310df8-a796-4d53-a3af-53aa9f98117d service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.921765 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-edb18563-1571-4a02-90ec-e4e754cca094 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 204 len: 0 microversion: 2.1 time: 0.298586 Jul 25 06:02:20.922360 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 219/449] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:02:20 2022] DELETE /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 06:02:20.929748 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-467fc3d1-ace6-4716-8a1e-79cf093d2c08 req-6d310df8-a796-4d53-a3af-53aa9f98117d service nova] Creating event network-vif-deleted:76c263b9-b74b-41c2-b7e7-d3f293d10eea for instance 7c1d7240-ffe0-424b-aa2c-f44036123979 on hv-cinder-84841 Jul 25 06:02:20.931509 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-066420fc-a3aa-4388-b124-849263948181 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:20.932059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-066420fc-a3aa-4388-b124-849263948181 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:20.935514 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-467fc3d1-ace6-4716-8a1e-79cf093d2c08 req-6d310df8-a796-4d53-a3af-53aa9f98117d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030165 Jul 25 06:02:20.936096 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 231/450] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:02:20.938159 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-066420fc-a3aa-4388-b124-849263948181 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.938541 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-066420fc-a3aa-4388-b124-849263948181 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:20.939306 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-066420fc-a3aa-4388-b124-849263948181 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:20.939741 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-066420fc-a3aa-4388-b124-849263948181 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:21.051646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-72588c47-3daf-4055-8dc3-46ea353103a2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:21.052458 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-72588c47-3daf-4055-8dc3-46ea353103a2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:21.059919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-72588c47-3daf-4055-8dc3-46ea353103a2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:21.060387 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-72588c47-3daf-4055-8dc3-46ea353103a2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:21.061142 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-72588c47-3daf-4055-8dc3-46ea353103a2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:21.061571 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-72588c47-3daf-4055-8dc3-46ea353103a2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:21.079854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-066420fc-a3aa-4388-b124-849263948181 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:21.088014 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-066420fc-a3aa-4388-b124-849263948181 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1512 microversion: 2.1 time: 0.161039 Jul 25 06:02:21.088715 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 220/451] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:20 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:21.123992 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-72588c47-3daf-4055-8dc3-46ea353103a2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:21.131504 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-72588c47-3daf-4055-8dc3-46ea353103a2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1460 microversion: 2.1 time: 0.084333 Jul 25 06:02:21.132063 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 232/452] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:21 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1460 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:21.323567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a3c1a61d-b34a-4a5f-94dd-be345c6cd78c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:21.324194 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a3c1a61d-b34a-4a5f-94dd-be345c6cd78c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:21.330663 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a3c1a61d-b34a-4a5f-94dd-be345c6cd78c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:21.331043 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a3c1a61d-b34a-4a5f-94dd-be345c6cd78c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:21.331785 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a3c1a61d-b34a-4a5f-94dd-be345c6cd78c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:21.332274 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a3c1a61d-b34a-4a5f-94dd-be345c6cd78c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:21.459142 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a3c1a61d-b34a-4a5f-94dd-be345c6cd78c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:21.467203 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a3c1a61d-b34a-4a5f-94dd-be345c6cd78c tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.148359 Jul 25 06:02:21.468004 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 221/453] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:21 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:21.675366 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e736d06d-ee8a-496e-8d33-95330eec988d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:21.676027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e736d06d-ee8a-496e-8d33-95330eec988d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:21.682751 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e736d06d-ee8a-496e-8d33-95330eec988d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:21.683192 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e736d06d-ee8a-496e-8d33-95330eec988d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:21.683952 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e736d06d-ee8a-496e-8d33-95330eec988d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:21.684409 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e736d06d-ee8a-496e-8d33-95330eec988d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:21.812040 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e736d06d-ee8a-496e-8d33-95330eec988d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:21.820144 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e736d06d-ee8a-496e-8d33-95330eec988d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:21.822190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e736d06d-ee8a-496e-8d33-95330eec988d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:21.823343 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e736d06d-ee8a-496e-8d33-95330eec988d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1719 microversion: 2.20 time: 0.151997 Jul 25 06:02:21.823905 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 233/454] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:21 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:22.105653 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-af3868f3-fa8d-4c56-8205-217e0662e162 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:22.106182 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-af3868f3-fa8d-4c56-8205-217e0662e162 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:22.112154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af3868f3-fa8d-4c56-8205-217e0662e162 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.112598 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af3868f3-fa8d-4c56-8205-217e0662e162 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.113380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af3868f3-fa8d-4c56-8205-217e0662e162 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.113807 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af3868f3-fa8d-4c56-8205-217e0662e162 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.149063 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7c1d1fd9-523c-4ccb-a9d8-6b5f75c8ef0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:22.149801 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7c1d1fd9-523c-4ccb-a9d8-6b5f75c8ef0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:22.156244 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7c1d1fd9-523c-4ccb-a9d8-6b5f75c8ef0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.156683 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7c1d1fd9-523c-4ccb-a9d8-6b5f75c8ef0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.157438 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7c1d1fd9-523c-4ccb-a9d8-6b5f75c8ef0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.157866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7c1d1fd9-523c-4ccb-a9d8-6b5f75c8ef0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.219910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7c1d1fd9-523c-4ccb-a9d8-6b5f75c8ef0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:22.227563 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7c1d1fd9-523c-4ccb-a9d8-6b5f75c8ef0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1460 microversion: 2.1 time: 0.082170 Jul 25 06:02:22.228356 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 234/455] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:22 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1460 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:22.246581 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-af3868f3-fa8d-4c56-8205-217e0662e162 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:22.254126 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-af3868f3-fa8d-4c56-8205-217e0662e162 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1512 microversion: 2.1 time: 0.152773 Jul 25 06:02:22.254690 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 222/456] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:22 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:22.484457 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b4973100-bd3c-4cba-b1d2-e064b2501d1b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:22.485095 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b4973100-bd3c-4cba-b1d2-e064b2501d1b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:22.491008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b4973100-bd3c-4cba-b1d2-e064b2501d1b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.491449 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b4973100-bd3c-4cba-b1d2-e064b2501d1b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.492223 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b4973100-bd3c-4cba-b1d2-e064b2501d1b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.492656 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b4973100-bd3c-4cba-b1d2-e064b2501d1b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.627785 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b4973100-bd3c-4cba-b1d2-e064b2501d1b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:22.636081 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b4973100-bd3c-4cba-b1d2-e064b2501d1b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.155574 Jul 25 06:02:22.636676 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 235/457] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:22 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:22.841085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-cba4f91f-4750-4861-ade2-b1e9e47ca355 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:22.841684 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-cba4f91f-4750-4861-ade2-b1e9e47ca355 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:22.848138 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cba4f91f-4750-4861-ade2-b1e9e47ca355 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.848582 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cba4f91f-4750-4861-ade2-b1e9e47ca355 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.849419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cba4f91f-4750-4861-ade2-b1e9e47ca355 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:22.849843 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cba4f91f-4750-4861-ade2-b1e9e47ca355 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:22.979839 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cba4f91f-4750-4861-ade2-b1e9e47ca355 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:22.987749 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cba4f91f-4750-4861-ade2-b1e9e47ca355 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:22.989301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cba4f91f-4750-4861-ade2-b1e9e47ca355 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:22.990445 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-cba4f91f-4750-4861-ade2-b1e9e47ca355 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1719 microversion: 2.20 time: 0.153278 Jul 25 06:02:22.994528 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 223/458] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:22 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:23.244538 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6e1f00b5-5a8f-4542-8b22-ff43c2d46e08 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:23.245152 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6e1f00b5-5a8f-4542-8b22-ff43c2d46e08 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:23.251636 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e1f00b5-5a8f-4542-8b22-ff43c2d46e08 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.252085 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e1f00b5-5a8f-4542-8b22-ff43c2d46e08 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.252871 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e1f00b5-5a8f-4542-8b22-ff43c2d46e08 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.253306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e1f00b5-5a8f-4542-8b22-ff43c2d46e08 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.271286 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-78546423-616e-4e9c-a0c2-02c278cbc3b3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:23.271899 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-78546423-616e-4e9c-a0c2-02c278cbc3b3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:23.278548 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-78546423-616e-4e9c-a0c2-02c278cbc3b3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.278999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-78546423-616e-4e9c-a0c2-02c278cbc3b3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.279767 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-78546423-616e-4e9c-a0c2-02c278cbc3b3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.280231 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-78546423-616e-4e9c-a0c2-02c278cbc3b3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.314526 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6e1f00b5-5a8f-4542-8b22-ff43c2d46e08 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:23.322682 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6e1f00b5-5a8f-4542-8b22-ff43c2d46e08 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1298 microversion: 2.1 time: 0.082088 Jul 25 06:02:23.323257 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 236/459] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:23 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:23.406002 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-78546423-616e-4e9c-a0c2-02c278cbc3b3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:23.413371 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-78546423-616e-4e9c-a0c2-02c278cbc3b3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1512 microversion: 2.1 time: 0.146140 Jul 25 06:02:23.413935 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 224/460] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:23 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:23.653334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-eb7c524a-83fb-409e-8084-15fb4cdb3514 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:23.653864 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-eb7c524a-83fb-409e-8084-15fb4cdb3514 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:23.659819 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eb7c524a-83fb-409e-8084-15fb4cdb3514 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.660303 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eb7c524a-83fb-409e-8084-15fb4cdb3514 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.661050 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eb7c524a-83fb-409e-8084-15fb4cdb3514 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:23.661478 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eb7c524a-83fb-409e-8084-15fb4cdb3514 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:23.786607 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-eb7c524a-83fb-409e-8084-15fb4cdb3514 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:23.790723 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:23.795067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-eb7c524a-83fb-409e-8084-15fb4cdb3514 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.146012 Jul 25 06:02:23.795625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 237/461] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:23 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:24.009645 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5822a441-80b1-4ebf-912a-2a5791bff515 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:24.010251 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5822a441-80b1-4ebf-912a-2a5791bff515 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.016874 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5822a441-80b1-4ebf-912a-2a5791bff515 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.017813 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5822a441-80b1-4ebf-912a-2a5791bff515 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.018061 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5822a441-80b1-4ebf-912a-2a5791bff515 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.019012 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5822a441-80b1-4ebf-912a-2a5791bff515 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.153985 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5822a441-80b1-4ebf-912a-2a5791bff515 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:24.162316 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5822a441-80b1-4ebf-912a-2a5791bff515 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:24.163824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5822a441-80b1-4ebf-912a-2a5791bff515 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:24.165118 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5822a441-80b1-4ebf-912a-2a5791bff515 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1719 microversion: 2.20 time: 0.159565 Jul 25 06:02:24.166025 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 225/462] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:24 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:24.339080 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-45dc68e5-93e0-49bb-8b60-f5fe55095dd4 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:24.339691 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-45dc68e5-93e0-49bb-8b60-f5fe55095dd4 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.346594 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-45dc68e5-93e0-49bb-8b60-f5fe55095dd4 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.347042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-45dc68e5-93e0-49bb-8b60-f5fe55095dd4 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.347805 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-45dc68e5-93e0-49bb-8b60-f5fe55095dd4 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.348288 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-45dc68e5-93e0-49bb-8b60-f5fe55095dd4 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.421375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-45dc68e5-93e0-49bb-8b60-f5fe55095dd4 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:24.430421 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-45dc68e5-93e0-49bb-8b60-f5fe55095dd4 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1298 microversion: 2.1 time: 0.095436 Jul 25 06:02:24.432545 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 238/463] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:24 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:24.434081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b824b0ee-ef73-4425-bc39-6924a2d15627 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:24.434863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b824b0ee-ef73-4425-bc39-6924a2d15627 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.441314 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b824b0ee-ef73-4425-bc39-6924a2d15627 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.441743 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b824b0ee-ef73-4425-bc39-6924a2d15627 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.442503 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b824b0ee-ef73-4425-bc39-6924a2d15627 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.442962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b824b0ee-ef73-4425-bc39-6924a2d15627 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.589056 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b824b0ee-ef73-4425-bc39-6924a2d15627 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:24.596474 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b824b0ee-ef73-4425-bc39-6924a2d15627 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1512 microversion: 2.1 time: 0.169598 Jul 25 06:02:24.599705 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 226/464] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:24 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:24.811865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f83007cd-82b6-4c6f-b20d-b8e6e227f2d1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:24.812739 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f83007cd-82b6-4c6f-b20d-b8e6e227f2d1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:24.814655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:24.819485 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f83007cd-82b6-4c6f-b20d-b8e6e227f2d1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.819945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f83007cd-82b6-4c6f-b20d-b8e6e227f2d1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:24.820738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f83007cd-82b6-4c6f-b20d-b8e6e227f2d1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:24.821707 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f83007cd-82b6-4c6f-b20d-b8e6e227f2d1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.068274 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f83007cd-82b6-4c6f-b20d-b8e6e227f2d1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:25.076859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f83007cd-82b6-4c6f-b20d-b8e6e227f2d1 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.268921 Jul 25 06:02:25.077427 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 239/465] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:24 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:25.183611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-89ad9b5e-ef53-4a4a-9514-395fc7425df2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:25.194253 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-89ad9b5e-ef53-4a4a-9514-395fc7425df2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:25.201703 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-89ad9b5e-ef53-4a4a-9514-395fc7425df2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.202437 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-89ad9b5e-ef53-4a4a-9514-395fc7425df2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.203313 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-89ad9b5e-ef53-4a4a-9514-395fc7425df2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.203860 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-89ad9b5e-ef53-4a4a-9514-395fc7425df2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.340149 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-89ad9b5e-ef53-4a4a-9514-395fc7425df2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:25.348014 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-89ad9b5e-ef53-4a4a-9514-395fc7425df2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:25.349693 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-89ad9b5e-ef53-4a4a-9514-395fc7425df2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:25.350825 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-89ad9b5e-ef53-4a4a-9514-395fc7425df2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1722 microversion: 2.20 time: 0.171855 Jul 25 06:02:25.351388 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 227/466] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:25 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:25.369598 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d3bf339d-4678-420a-bcce-f5e00ab2c7c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f1c0>>, body: {"volumeAttachment": {"volumeId": "b8827126-a89f-4e58-b716-c8e077bb84c4"}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:25.371210 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d3bf339d-4678-420a-bcce-f5e00ab2c7c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:25.377694 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d3bf339d-4678-420a-bcce-f5e00ab2c7c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.378140 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d3bf339d-4678-420a-bcce-f5e00ab2c7c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.378894 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d3bf339d-4678-420a-bcce-f5e00ab2c7c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.379320 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d3bf339d-4678-420a-bcce-f5e00ab2c7c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.451953 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-06dee631-1a7f-4ea6-87ff-8c77fd846207 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:25.451953 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-06dee631-1a7f-4ea6-87ff-8c77fd846207 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:25.458399 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06dee631-1a7f-4ea6-87ff-8c77fd846207 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.458849 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06dee631-1a7f-4ea6-87ff-8c77fd846207 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.459633 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06dee631-1a7f-4ea6-87ff-8c77fd846207 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.460041 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06dee631-1a7f-4ea6-87ff-8c77fd846207 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.491587 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06dee631-1a7f-4ea6-87ff-8c77fd846207 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.492036 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06dee631-1a7f-4ea6-87ff-8c77fd846207 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.492512 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-06dee631-1a7f-4ea6-87ff-8c77fd846207 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lazy-loading 'fault' on Instance uuid 7c1d7240-ffe0-424b-aa2c-f44036123979 {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:02:25.536681 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-06dee631-1a7f-4ea6-87ff-8c77fd846207 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:25.544270 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-06dee631-1a7f-4ea6-87ff-8c77fd846207 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1303 microversion: 2.1 time: 0.099599 Jul 25 06:02:25.544832 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 228/467] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:25 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:25.549160 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-de495aea-e612-4e4e-8548-03fd37420322 req-2ef58d2b-8019-4cb5-b976-2af5b4eb30b4 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "2abbf803-6310-4fcd-bc09-ff506fab0a30", "name": "network-vif-deleted", "tag": "c773c2c6-02cb-4486-8cdb-0116d19cfa92"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:25.557965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-de495aea-e612-4e4e-8548-03fd37420322 req-2ef58d2b-8019-4cb5-b976-2af5b4eb30b4 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.558405 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-de495aea-e612-4e4e-8548-03fd37420322 req-2ef58d2b-8019-4cb5-b976-2af5b4eb30b4 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.571001 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-de495aea-e612-4e4e-8548-03fd37420322 req-2ef58d2b-8019-4cb5-b976-2af5b4eb30b4 service nova] Creating event network-vif-deleted:c773c2c6-02cb-4486-8cdb-0116d19cfa92 for instance 2abbf803-6310-4fcd-bc09-ff506fab0a30 on hv-cinder-84841 Jul 25 06:02:25.576706 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-de495aea-e612-4e4e-8548-03fd37420322 req-2ef58d2b-8019-4cb5-b976-2af5b4eb30b4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030755 Jul 25 06:02:25.577330 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 229/468] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:25.614226 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c29e024f-9359-4469-bbda-3c2ef1941444 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:25.614852 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c29e024f-9359-4469-bbda-3c2ef1941444 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:25.621555 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c29e024f-9359-4469-bbda-3c2ef1941444 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.622000 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c29e024f-9359-4469-bbda-3c2ef1941444 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.622778 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c29e024f-9359-4469-bbda-3c2ef1941444 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:25.623207 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c29e024f-9359-4469-bbda-3c2ef1941444 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:25.685714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c29e024f-9359-4469-bbda-3c2ef1941444 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:25.693210 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c29e024f-9359-4469-bbda-3c2ef1941444 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1470 microversion: 2.1 time: 0.083070 Jul 25 06:02:25.693767 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 230/469] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:25 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1470 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:26.098286 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-baf13968-7a01-4f64-855c-e308246b45b0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:26.098992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-baf13968-7a01-4f64-855c-e308246b45b0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:26.107062 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-baf13968-7a01-4f64-855c-e308246b45b0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.107548 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-baf13968-7a01-4f64-855c-e308246b45b0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.108505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-baf13968-7a01-4f64-855c-e308246b45b0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.109133 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-baf13968-7a01-4f64-855c-e308246b45b0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.251871 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-baf13968-7a01-4f64-855c-e308246b45b0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:26.260488 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-baf13968-7a01-4f64-855c-e308246b45b0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1314 microversion: 2.1 time: 0.168452 Jul 25 06:02:26.261053 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 231/470] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:26 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:26.372874 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d3bf339d-4678-420a-bcce-f5e00ab2c7c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "POST /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.007739 Jul 25 06:02:26.373655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 240/471] 10.222.0.40 () {62 vars in 1363 bytes} [Mon Jul 25 06:02:25 2022] POST /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments => generated 188 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:02:26.485813 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c996d38d-1aec-4da8-808f-8c2fe7411e20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Action: 'action', calling method: <bound method ShelveController._unshelve of <nova.api.openstack.compute.shelve.ShelveController object at 0x7f6533edda60>>, body: {"unshelve": null} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:26.486367 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c996d38d-1aec-4da8-808f-8c2fe7411e20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:26.492877 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c996d38d-1aec-4da8-808f-8c2fe7411e20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.493897 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c996d38d-1aec-4da8-808f-8c2fe7411e20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.494660 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c996d38d-1aec-4da8-808f-8c2fe7411e20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.495091 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c996d38d-1aec-4da8-808f-8c2fe7411e20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.561420 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5a3cb721-9ba9-4852-af7c-3be8c227af66 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:26.562043 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5a3cb721-9ba9-4852-af7c-3be8c227af66 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:26.571861 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5a3cb721-9ba9-4852-af7c-3be8c227af66 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.572239 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5a3cb721-9ba9-4852-af7c-3be8c227af66 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.573002 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5a3cb721-9ba9-4852-af7c-3be8c227af66 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.573429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5a3cb721-9ba9-4852-af7c-3be8c227af66 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.603041 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5a3cb721-9ba9-4852-af7c-3be8c227af66 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.603475 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5a3cb721-9ba9-4852-af7c-3be8c227af66 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.603923 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-5a3cb721-9ba9-4852-af7c-3be8c227af66 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lazy-loading 'fault' on Instance uuid 7c1d7240-ffe0-424b-aa2c-f44036123979 {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:02:26.646418 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5a3cb721-9ba9-4852-af7c-3be8c227af66 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:26.654849 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5a3cb721-9ba9-4852-af7c-3be8c227af66 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 200 len: 1303 microversion: 2.1 time: 0.097313 Jul 25 06:02:26.655417 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 241/472] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:26 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:26.710982 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5c951cd3-3c6f-4ac6-aa41-bd28ce2354e4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:26.711600 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5c951cd3-3c6f-4ac6-aa41-bd28ce2354e4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:26.718080 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5c951cd3-3c6f-4ac6-aa41-bd28ce2354e4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.718537 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5c951cd3-3c6f-4ac6-aa41-bd28ce2354e4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.719328 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5c951cd3-3c6f-4ac6-aa41-bd28ce2354e4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.719776 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5c951cd3-3c6f-4ac6-aa41-bd28ce2354e4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.730672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c996d38d-1aec-4da8-808f-8c2fe7411e20 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "POST /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/action" status: 202 len: 0 microversion: 2.20 time: 0.245891 Jul 25 06:02:26.731268 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 232/473] 10.222.0.40 () {62 vars in 1318 bytes} [Mon Jul 25 06:02:26 2022] POST /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:02:26.743710 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-138cea14-f820-44e4-95b6-b8043fba034e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:26.743933 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-138cea14-f820-44e4-95b6-b8043fba034e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:26.759397 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-138cea14-f820-44e4-95b6-b8043fba034e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.760099 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-138cea14-f820-44e4-95b6-b8043fba034e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.760842 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-138cea14-f820-44e4-95b6-b8043fba034e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:26.761279 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-138cea14-f820-44e4-95b6-b8043fba034e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:26.793780 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5c951cd3-3c6f-4ac6-aa41-bd28ce2354e4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:26.802769 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5c951cd3-3c6f-4ac6-aa41-bd28ce2354e4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 200 len: 1303 microversion: 2.1 time: 0.095532 Jul 25 06:02:26.812306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 242/474] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:26 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:26.928319 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-138cea14-f820-44e4-95b6-b8043fba034e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:26.937471 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-138cea14-f820-44e4-95b6-b8043fba034e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:26.939649 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-138cea14-f820-44e4-95b6-b8043fba034e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:26.948558 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-138cea14-f820-44e4-95b6-b8043fba034e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1748 microversion: 2.20 time: 0.210041 Jul 25 06:02:26.952167 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 233/475] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:26 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1748 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:27.277547 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4d813e60-23a5-4714-9024-d3af8f359f6a tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:27.278258 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4d813e60-23a5-4714-9024-d3af8f359f6a tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:27.284360 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4d813e60-23a5-4714-9024-d3af8f359f6a tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.284805 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4d813e60-23a5-4714-9024-d3af8f359f6a tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.285562 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4d813e60-23a5-4714-9024-d3af8f359f6a tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.285992 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4d813e60-23a5-4714-9024-d3af8f359f6a tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.417607 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4d813e60-23a5-4714-9024-d3af8f359f6a tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:27.426394 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4d813e60-23a5-4714-9024-d3af8f359f6a tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1463 microversion: 2.1 time: 0.152744 Jul 25 06:02:27.427897 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 243/476] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:27 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:27.469681 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-43d6186c-c663-4b4f-9a58-3ca2553af158 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:27.471512 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-43d6186c-c663-4b4f-9a58-3ca2553af158 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:27.476181 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-43d6186c-c663-4b4f-9a58-3ca2553af158 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.476630 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-43d6186c-c663-4b4f-9a58-3ca2553af158 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.477393 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-43d6186c-c663-4b4f-9a58-3ca2553af158 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.477890 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-43d6186c-c663-4b4f-9a58-3ca2553af158 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.504240 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-43d6186c-c663-4b4f-9a58-3ca2553af158 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:02:27.508248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:27.671548 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6ba8ed4c-1a00-49c1-b51f-483664613d72 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:27.672185 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6ba8ed4c-1a00-49c1-b51f-483664613d72 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 7c1d7240-ffe0-424b-aa2c-f44036123979] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:27.678765 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6ba8ed4c-1a00-49c1-b51f-483664613d72 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.684155 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6ba8ed4c-1a00-49c1-b51f-483664613d72 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.684155 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6ba8ed4c-1a00-49c1-b51f-483664613d72 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.684155 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6ba8ed4c-1a00-49c1-b51f-483664613d72 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.695247 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-6ba8ed4c-1a00-49c1-b51f-483664613d72 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] HTTP exception thrown: Instance 7c1d7240-ffe0-424b-aa2c-f44036123979 could not be found. Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6ba8ed4c-1a00-49c1-b51f-483664613d72 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Request method failure captured: Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 HTTP/1.1 Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jHKAlx8fEy_1jSW2Ry9VpGEvWKT-utTOOhj7vDsTOOmHUwwBoFp8paPo9X9HHCvvbo1nNahzt2vPUHbke9KT4RN8jmrILEczQ289KA28GLc57pxscyaKIHLBxsoWIEaxO5pzFFKbU0o_dIKjfE8hcPDbjdneJ_yo0O0un8-y4fWTDs Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: e3f62f9df69f47d0ad40154526b95be1 Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-VolumesActionsTest-1809851383 Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:02:27.697493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3f62f9df69f47d0ad40154526b95be1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3f62f9df69f47d0ad40154526b95be1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3f62f9df69f47d0ad40154526b95be1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3f62f9df69f47d0ad40154526b95be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-VolumesActionsTest-1809851383 Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: e3f62f9df69f47d0ad40154526b95be1 Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-VolumesActionsTest-1809851383 Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-VolumesActionsTest-1809851383-project Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 66f64211ceb949d398e47bc18e2abbca Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-VolumesActionsTest-1809851383-project Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance 7c1d7240-ffe0-424b-aa2c-f44036123979 could not be found. Jul 25 06:02:27.699162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': '7c1d7240-ffe0-424b-aa2c-f44036123979'} Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c1d7240-ffe0-424b-aa2c-f44036123979 could not be found. Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:02:27.700045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c1d7240-ffe0-424b-aa2c-f44036123979 could not be found. Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c1d7240-ffe0-424b-aa2c-f44036123979 could not be found. Jul 25 06:02:27.701578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:02:27.703652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6ba8ed4c-1a00-49c1-b51f-483664613d72 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Returning 404 to user: Instance 7c1d7240-ffe0-424b-aa2c-f44036123979 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:02:27.703652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6ba8ed4c-1a00-49c1-b51f-483664613d72 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979" status: 404 len: 111 microversion: 2.1 time: 0.031200 Jul 25 06:02:27.703652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 244/477] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:27 2022] GET /compute/v2.1/servers/7c1d7240-ffe0-424b-aa2c-f44036123979 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:02:27.822235 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-181ba518-92ff-46f4-8a53-8e85a849c765 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:27.822235 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-181ba518-92ff-46f4-8a53-8e85a849c765 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 2abbf803-6310-4fcd-bc09-ff506fab0a30] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:27.828058 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-181ba518-92ff-46f4-8a53-8e85a849c765 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.828541 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-181ba518-92ff-46f4-8a53-8e85a849c765 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.829487 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-181ba518-92ff-46f4-8a53-8e85a849c765 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.829923 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-181ba518-92ff-46f4-8a53-8e85a849c765 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.844854 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-181ba518-92ff-46f4-8a53-8e85a849c765 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] HTTP exception thrown: Instance 2abbf803-6310-4fcd-bc09-ff506fab0a30 could not be found. Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-181ba518-92ff-46f4-8a53-8e85a849c765 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Request method failure captured: Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 HTTP/1.1 Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jGZzVbEb49g81Ce7iPzr4bigt-YbPkWh0ieZMiTpt0w0bFcE5InohRlkd1OZuuSGNXTHW2cRPilRe4GuWcPv6x34vo3YDKydq4ApYHbgk31pFAMUP0KUA7_wNP1Men50HZNLsYS8u0unTj0QxscZzs-3chWHLn8uERBSZ-TqvNm3Kw Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 7d97f354896a4f1bbef0b4d1e6b99c27 Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1573749398 Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:02:27.846375 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7d97f354896a4f1bbef0b4d1e6b99c27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d97f354896a4f1bbef0b4d1e6b99c27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7d97f354896a4f1bbef0b4d1e6b99c27", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d97f354896a4f1bbef0b4d1e6b99c27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-VolumesSnapshotTestJSON-1573749398 Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 7d97f354896a4f1bbef0b4d1e6b99c27 Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1573749398 Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-VolumesSnapshotTestJSON-1573749398-project Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 5caf24262d214d9aa8cf9612582154f5 Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-VolumesSnapshotTestJSON-1573749398-project Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance 2abbf803-6310-4fcd-bc09-ff506fab0a30 could not be found. Jul 25 06:02:27.847938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': '2abbf803-6310-4fcd-bc09-ff506fab0a30'} Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2abbf803-6310-4fcd-bc09-ff506fab0a30 could not be found. Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:02:27.848811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abbf803-6310-4fcd-bc09-ff506fab0a30 could not be found. Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abbf803-6310-4fcd-bc09-ff506fab0a30 could not be found. Jul 25 06:02:27.849962 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:02:27.850989 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-181ba518-92ff-46f4-8a53-8e85a849c765 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Returning 404 to user: Instance 2abbf803-6310-4fcd-bc09-ff506fab0a30 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:02:27.850989 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-181ba518-92ff-46f4-8a53-8e85a849c765 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30" status: 404 len: 111 microversion: 2.1 time: 0.031710 Jul 25 06:02:27.850989 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 245/478] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:27 2022] GET /compute/v2.1/servers/2abbf803-6310-4fcd-bc09-ff506fab0a30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:02:27.853407 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-VolumesActionsTest-instance-516914410", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "networks": [{"uuid": "1387b5b1-b22c-45c9-8c0b-cbb5a7580640"}]}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:27.855715 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-43d6186c-c663-4b4f-9a58-3ca2553af158 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 204 len: 0 microversion: 2.1 time: 0.389698 Jul 25 06:02:27.856460 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 234/479] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:02:27 2022] DELETE /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:02:27.880501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7fdacc0b-e236-4afd-9b40-dd946ef858c0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:27.881207 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7fdacc0b-e236-4afd-9b40-dd946ef858c0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:27.894040 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7fdacc0b-e236-4afd-9b40-dd946ef858c0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.894488 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7fdacc0b-e236-4afd-9b40-dd946ef858c0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.895331 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7fdacc0b-e236-4afd-9b40-dd946ef858c0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:27.895763 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7fdacc0b-e236-4afd-9b40-dd946ef858c0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:27.918829 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] validate_networks() for [('1387b5b1-b22c-45c9-8c0b-cbb5a7580640', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:02:28.043643 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7fdacc0b-e236-4afd-9b40-dd946ef858c0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:28.051428 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7fdacc0b-e236-4afd-9b40-dd946ef858c0 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1469 microversion: 2.1 time: 0.182287 Jul 25 06:02:28.052004 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 235/480] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:27 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:28.057151 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f156f02f-2277-46cf-bcef-1dee6439a98d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:28.057966 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f156f02f-2277-46cf-bcef-1dee6439a98d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:28.063901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f156f02f-2277-46cf-bcef-1dee6439a98d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:28.064729 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f156f02f-2277-46cf-bcef-1dee6439a98d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:28.065836 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f156f02f-2277-46cf-bcef-1dee6439a98d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:28.066436 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f156f02f-2277-46cf-bcef-1dee6439a98d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:28.229571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f156f02f-2277-46cf-bcef-1dee6439a98d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:28.238033 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f156f02f-2277-46cf-bcef-1dee6439a98d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:28.239544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f156f02f-2277-46cf-bcef-1dee6439a98d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:28.240770 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f156f02f-2277-46cf-bcef-1dee6439a98d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1748 microversion: 2.20 time: 0.187783 Jul 25 06:02:28.241326 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 236/481] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:28 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1748 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:28.291214 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:02:28.291214 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:02:28.292098 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:02:28.292713 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:02:28.293137 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:02:28.303733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:28.304219 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:28.305053 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:28.305486 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:28.324288 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Getting quotas for project e3f62f9df69f47d0ad40154526b95be1. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:02:28.328362 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Getting quotas for user 66f64211ceb949d398e47bc18e2abbca and project e3f62f9df69f47d0ad40154526b95be1. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:02:28.339292 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:02:28.341648 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:02:28.468493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-26ba5bfd-611f-422f-88c1-609bac92284e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619187 Jul 25 06:02:28.469141 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 246/482] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:02:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:02:28.479688 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c51f8cb9-a571-41b6-8c37-90f41523e9e7 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:28.480338 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c51f8cb9-a571-41b6-8c37-90f41523e9e7 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:28.539586 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c51f8cb9-a571-41b6-8c37-90f41523e9e7 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:28.547294 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c51f8cb9-a571-41b6-8c37-90f41523e9e7 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1213 microversion: 2.1 time: 0.071950 Jul 25 06:02:28.548276 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 237/483] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:28 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:29.071022 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b126a2ec-2e1b-4faf-8c6c-66797bf3a334 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:29.071649 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b126a2ec-2e1b-4faf-8c6c-66797bf3a334 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:29.077779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b126a2ec-2e1b-4faf-8c6c-66797bf3a334 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.078228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b126a2ec-2e1b-4faf-8c6c-66797bf3a334 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.078989 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b126a2ec-2e1b-4faf-8c6c-66797bf3a334 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.079428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b126a2ec-2e1b-4faf-8c6c-66797bf3a334 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.209568 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b126a2ec-2e1b-4faf-8c6c-66797bf3a334 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:29.217726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b126a2ec-2e1b-4faf-8c6c-66797bf3a334 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1469 microversion: 2.1 time: 0.151306 Jul 25 06:02:29.218285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 247/484] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:29 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:29.260150 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4b983bd1-da82-47f8-8d5b-4f4d95c03548 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:29.260781 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4b983bd1-da82-47f8-8d5b-4f4d95c03548 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:29.266687 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b983bd1-da82-47f8-8d5b-4f4d95c03548 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.267072 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b983bd1-da82-47f8-8d5b-4f4d95c03548 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.267819 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b983bd1-da82-47f8-8d5b-4f4d95c03548 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.268275 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b983bd1-da82-47f8-8d5b-4f4d95c03548 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.400655 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4b983bd1-da82-47f8-8d5b-4f4d95c03548 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:29.408950 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4b983bd1-da82-47f8-8d5b-4f4d95c03548 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:29.410446 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4b983bd1-da82-47f8-8d5b-4f4d95c03548 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:29.411584 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4b983bd1-da82-47f8-8d5b-4f4d95c03548 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1748 microversion: 2.20 time: 0.155985 Jul 25 06:02:29.412340 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 238/485] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:29 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:29.565519 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3dd996f4-df3f-4ca0-8298-2f50b5df7cda tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:29.566056 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3dd996f4-df3f-4ca0-8298-2f50b5df7cda tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:29.572788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3dd996f4-df3f-4ca0-8298-2f50b5df7cda tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.573236 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3dd996f4-df3f-4ca0-8298-2f50b5df7cda tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.573986 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3dd996f4-df3f-4ca0-8298-2f50b5df7cda tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:29.574434 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3dd996f4-df3f-4ca0-8298-2f50b5df7cda tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:29.637465 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3dd996f4-df3f-4ca0-8298-2f50b5df7cda tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:29.645156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3dd996f4-df3f-4ca0-8298-2f50b5df7cda tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1217 microversion: 2.1 time: 0.083602 Jul 25 06:02:29.645714 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 248/486] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:29 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:30.234006 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2b9a217e-6a01-4a0f-9b23-fbee6488c518 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:30.234734 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2b9a217e-6a01-4a0f-9b23-fbee6488c518 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:30.241635 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2b9a217e-6a01-4a0f-9b23-fbee6488c518 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.242157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2b9a217e-6a01-4a0f-9b23-fbee6488c518 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.242912 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2b9a217e-6a01-4a0f-9b23-fbee6488c518 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.244175 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2b9a217e-6a01-4a0f-9b23-fbee6488c518 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.379244 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2b9a217e-6a01-4a0f-9b23-fbee6488c518 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:30.387755 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2b9a217e-6a01-4a0f-9b23-fbee6488c518 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1469 microversion: 2.1 time: 0.157691 Jul 25 06:02:30.388351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 239/487] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:30 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:30.430198 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-550ebac3-8cff-4376-94ee-2413b8fba222 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:30.431605 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-550ebac3-8cff-4376-94ee-2413b8fba222 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:30.438301 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-550ebac3-8cff-4376-94ee-2413b8fba222 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.438733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-550ebac3-8cff-4376-94ee-2413b8fba222 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.439491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-550ebac3-8cff-4376-94ee-2413b8fba222 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.439922 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-550ebac3-8cff-4376-94ee-2413b8fba222 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.574989 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-550ebac3-8cff-4376-94ee-2413b8fba222 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:30.583722 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-550ebac3-8cff-4376-94ee-2413b8fba222 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:30.585502 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-550ebac3-8cff-4376-94ee-2413b8fba222 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:30.586661 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-550ebac3-8cff-4376-94ee-2413b8fba222 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1748 microversion: 2.20 time: 0.160384 Jul 25 06:02:30.587760 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 249/488] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:30 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:30.662606 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-bb0f69b2-178f-4639-a77f-db8eb208777a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:30.663213 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-bb0f69b2-178f-4639-a77f-db8eb208777a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:30.665324 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:30.670344 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bb0f69b2-178f-4639-a77f-db8eb208777a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.670786 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bb0f69b2-178f-4639-a77f-db8eb208777a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.671550 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bb0f69b2-178f-4639-a77f-db8eb208777a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:30.671982 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bb0f69b2-178f-4639-a77f-db8eb208777a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:30.738770 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-bb0f69b2-178f-4639-a77f-db8eb208777a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:30.746624 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-bb0f69b2-178f-4639-a77f-db8eb208777a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1217 microversion: 2.1 time: 0.087966 Jul 25 06:02:30.747188 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 240/489] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:30 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:31.406599 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-73e7a85e-5cd5-46df-8543-886b3dbd14f6 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:31.407228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-73e7a85e-5cd5-46df-8543-886b3dbd14f6 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:31.413231 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-73e7a85e-5cd5-46df-8543-886b3dbd14f6 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.413681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-73e7a85e-5cd5-46df-8543-886b3dbd14f6 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.414450 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-73e7a85e-5cd5-46df-8543-886b3dbd14f6 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.414887 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-73e7a85e-5cd5-46df-8543-886b3dbd14f6 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.581555 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-73e7a85e-5cd5-46df-8543-886b3dbd14f6 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:31.590279 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-73e7a85e-5cd5-46df-8543-886b3dbd14f6 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1469 microversion: 2.1 time: 0.187480 Jul 25 06:02:31.590893 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 250/490] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:31 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:31.606270 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6e8523d0-872c-4ac6-8acc-bff6d9df22c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:31.606875 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6e8523d0-872c-4ac6-8acc-bff6d9df22c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:31.613719 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e8523d0-872c-4ac6-8acc-bff6d9df22c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.614362 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e8523d0-872c-4ac6-8acc-bff6d9df22c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.615118 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e8523d0-872c-4ac6-8acc-bff6d9df22c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.615552 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e8523d0-872c-4ac6-8acc-bff6d9df22c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.752081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6e8523d0-872c-4ac6-8acc-bff6d9df22c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:31.762022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6e8523d0-872c-4ac6-8acc-bff6d9df22c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:31.763641 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6e8523d0-872c-4ac6-8acc-bff6d9df22c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:31.765984 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6e8523d0-872c-4ac6-8acc-bff6d9df22c8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1748 microversion: 2.20 time: 0.164221 Jul 25 06:02:31.766637 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 241/491] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:31 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:02:31.769189 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3388d3b1-09a1-40df-8aa4-5a065f8b9cbe tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:31.769864 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3388d3b1-09a1-40df-8aa4-5a065f8b9cbe tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:31.776664 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3388d3b1-09a1-40df-8aa4-5a065f8b9cbe tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.777112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3388d3b1-09a1-40df-8aa4-5a065f8b9cbe tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.777886 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3388d3b1-09a1-40df-8aa4-5a065f8b9cbe tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:31.778345 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3388d3b1-09a1-40df-8aa4-5a065f8b9cbe tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:31.856444 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3388d3b1-09a1-40df-8aa4-5a065f8b9cbe tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:31.859976 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3388d3b1-09a1-40df-8aa4-5a065f8b9cbe tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1217 microversion: 2.1 time: 0.099985 Jul 25 06:02:31.860592 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 251/492] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:31 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:32.610671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0519065d-568b-46b7-af09-ed1a9086ddd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:32.611267 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-0519065d-568b-46b7-af09-ed1a9086ddd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:32.617754 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0519065d-568b-46b7-af09-ed1a9086ddd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.618196 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0519065d-568b-46b7-af09-ed1a9086ddd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.619653 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0519065d-568b-46b7-af09-ed1a9086ddd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.620178 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0519065d-568b-46b7-af09-ed1a9086ddd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.693656 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-0519065d-568b-46b7-af09-ed1a9086ddd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:32.703252 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0519065d-568b-46b7-af09-ed1a9086ddd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1427 microversion: 2.1 time: 0.096469 Jul 25 06:02:32.703861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 242/493] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:32 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:32.755593 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-8658dffe-ab83-403a-a63e-ced5d35a4b23 req-fab1dfc2-6eb9-4cf1-890a-c8ac021a0a04 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "b0f37573-28da-4e81-9d33-c762d63aaa0d", "name": "network-vif-deleted", "tag": "c0702395-fb33-483b-89f6-9a4217997999"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:32.772437 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-8658dffe-ab83-403a-a63e-ced5d35a4b23 req-fab1dfc2-6eb9-4cf1-890a-c8ac021a0a04 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.772883 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-8658dffe-ab83-403a-a63e-ced5d35a4b23 req-fab1dfc2-6eb9-4cf1-890a-c8ac021a0a04 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.786603 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-8658dffe-ab83-403a-a63e-ced5d35a4b23 req-fab1dfc2-6eb9-4cf1-890a-c8ac021a0a04 service nova] Creating event network-vif-deleted:c0702395-fb33-483b-89f6-9a4217997999 for instance b0f37573-28da-4e81-9d33-c762d63aaa0d on hv-cinder-84841 Jul 25 06:02:32.789648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-202b6c63-b424-4805-9d41-57dc43395c8f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:32.790975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-202b6c63-b424-4805-9d41-57dc43395c8f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:32.794319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-8658dffe-ab83-403a-a63e-ced5d35a4b23 req-fab1dfc2-6eb9-4cf1-890a-c8ac021a0a04 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042735 Jul 25 06:02:32.794837 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 252/494] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:32.802776 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-202b6c63-b424-4805-9d41-57dc43395c8f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.803259 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-202b6c63-b424-4805-9d41-57dc43395c8f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.804052 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-202b6c63-b424-4805-9d41-57dc43395c8f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.804553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-202b6c63-b424-4805-9d41-57dc43395c8f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.879043 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3ef02a56-32c6-481c-9d79-fea7585c254f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:32.879739 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3ef02a56-32c6-481c-9d79-fea7585c254f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:32.892163 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ef02a56-32c6-481c-9d79-fea7585c254f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.892650 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ef02a56-32c6-481c-9d79-fea7585c254f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.893442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ef02a56-32c6-481c-9d79-fea7585c254f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:32.894134 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ef02a56-32c6-481c-9d79-fea7585c254f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:32.962951 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-202b6c63-b424-4805-9d41-57dc43395c8f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:32.967416 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3ef02a56-32c6-481c-9d79-fea7585c254f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:32.971710 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-202b6c63-b424-4805-9d41-57dc43395c8f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:32.973211 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-202b6c63-b424-4805-9d41-57dc43395c8f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:32.974349 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-202b6c63-b424-4805-9d41-57dc43395c8f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1750 microversion: 2.20 time: 0.189221 Jul 25 06:02:32.974902 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 243/495] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:32 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1750 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:32.976081 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3ef02a56-32c6-481c-9d79-fea7585c254f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1265 microversion: 2.1 time: 0.101390 Jul 25 06:02:32.976666 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 253/496] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:32 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:33.722072 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-33c6065d-8993-41f2-9641-99a36e70c87b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:33.723408 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-33c6065d-8993-41f2-9641-99a36e70c87b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:33.731315 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-33c6065d-8993-41f2-9641-99a36e70c87b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:33.732095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-33c6065d-8993-41f2-9641-99a36e70c87b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:33.733053 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-33c6065d-8993-41f2-9641-99a36e70c87b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:33.733648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-33c6065d-8993-41f2-9641-99a36e70c87b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:33.785351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-33c6065d-8993-41f2-9641-99a36e70c87b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:33.785958 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-33c6065d-8993-41f2-9641-99a36e70c87b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:33.786596 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-33c6065d-8993-41f2-9641-99a36e70c87b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lazy-loading 'fault' on Instance uuid b0f37573-28da-4e81-9d33-c762d63aaa0d {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:02:33.833102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-33c6065d-8993-41f2-9641-99a36e70c87b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:33.872348 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-33c6065d-8993-41f2-9641-99a36e70c87b tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1304 microversion: 2.1 time: 0.127014 Jul 25 06:02:33.872348 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 244/497] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:33 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:33.992697 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e28a0724-8c68-4126-8196-19221a5b3f28 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:33.993744 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b125775d-19f4-40b9-8e7b-b6ec5f8605e5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:33.993866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e28a0724-8c68-4126-8196-19221a5b3f28 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:33.994370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b125775d-19f4-40b9-8e7b-b6ec5f8605e5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:34.000550 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b125775d-19f4-40b9-8e7b-b6ec5f8605e5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:34.000704 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e28a0724-8c68-4126-8196-19221a5b3f28 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:34.000994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b125775d-19f4-40b9-8e7b-b6ec5f8605e5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:34.001100 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e28a0724-8c68-4126-8196-19221a5b3f28 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:34.001748 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b125775d-19f4-40b9-8e7b-b6ec5f8605e5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:34.001897 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e28a0724-8c68-4126-8196-19221a5b3f28 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:34.002183 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b125775d-19f4-40b9-8e7b-b6ec5f8605e5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:34.002319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e28a0724-8c68-4126-8196-19221a5b3f28 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:34.006425 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:34.144862 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b125775d-19f4-40b9-8e7b-b6ec5f8605e5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:34.152596 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b125775d-19f4-40b9-8e7b-b6ec5f8605e5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1325 microversion: 2.1 time: 0.163202 Jul 25 06:02:34.153164 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 245/498] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:33 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:34.224147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e28a0724-8c68-4126-8196-19221a5b3f28 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:34.233662 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e28a0724-8c68-4126-8196-19221a5b3f28 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:34.235306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e28a0724-8c68-4126-8196-19221a5b3f28 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:34.236869 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e28a0724-8c68-4126-8196-19221a5b3f28 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1750 microversion: 2.20 time: 0.248529 Jul 25 06:02:34.237430 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 254/499] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:33 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1750 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:34.890438 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5888e171-03bc-4f62-b95c-b94b76068968 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:34.891283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5888e171-03bc-4f62-b95c-b94b76068968 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:34.898117 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5888e171-03bc-4f62-b95c-b94b76068968 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:34.898565 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5888e171-03bc-4f62-b95c-b94b76068968 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:34.899320 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5888e171-03bc-4f62-b95c-b94b76068968 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:34.899800 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5888e171-03bc-4f62-b95c-b94b76068968 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:34.936661 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5888e171-03bc-4f62-b95c-b94b76068968 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:34.937103 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5888e171-03bc-4f62-b95c-b94b76068968 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:34.937546 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-5888e171-03bc-4f62-b95c-b94b76068968 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lazy-loading 'fault' on Instance uuid b0f37573-28da-4e81-9d33-c762d63aaa0d {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:02:34.982446 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5888e171-03bc-4f62-b95c-b94b76068968 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff863f4f7a2147239fb491097268c9e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0e6671f7e7e432b92deccdaf094fed4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:34.988801 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5888e171-03bc-4f62-b95c-b94b76068968 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 200 len: 1304 microversion: 2.1 time: 0.102201 Jul 25 06:02:34.989365 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 246/500] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:34 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:35.171620 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4ae935cc-a9d8-4a01-b37b-c1f7802d4491 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:35.172270 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4ae935cc-a9d8-4a01-b37b-c1f7802d4491 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:35.179192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-da1375e1-4b32-44eb-a61f-f9a9aac18e29 req-9feb58ba-293c-4cbe-91f6-29839e2ae1fd service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "65bf5eef-5bf1-458e-bed9-c7184fc1f2e2", "tag": "f2d5059f-ba0a-49d2-b470-adede8bbdc2e"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:35.179407 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4ae935cc-a9d8-4a01-b37b-c1f7802d4491 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.179823 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4ae935cc-a9d8-4a01-b37b-c1f7802d4491 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.180627 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4ae935cc-a9d8-4a01-b37b-c1f7802d4491 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.181065 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4ae935cc-a9d8-4a01-b37b-c1f7802d4491 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.188736 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-da1375e1-4b32-44eb-a61f-f9a9aac18e29 req-9feb58ba-293c-4cbe-91f6-29839e2ae1fd service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.189173 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-da1375e1-4b32-44eb-a61f-f9a9aac18e29 req-9feb58ba-293c-4cbe-91f6-29839e2ae1fd service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.209096 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-da1375e1-4b32-44eb-a61f-f9a9aac18e29 req-9feb58ba-293c-4cbe-91f6-29839e2ae1fd service nova] Creating event network-changed:f2d5059f-ba0a-49d2-b470-adede8bbdc2e for instance 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 on hv-cinder-84841 Jul 25 06:02:35.214849 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-da1375e1-4b32-44eb-a61f-f9a9aac18e29 req-9feb58ba-293c-4cbe-91f6-29839e2ae1fd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040024 Jul 25 06:02:35.215714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 247/501] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:02:35.256749 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2feb47a5-cdc0-4bcd-a3d6-f6698448ad29 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:35.257443 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2feb47a5-cdc0-4bcd-a3d6-f6698448ad29 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:35.264553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2feb47a5-cdc0-4bcd-a3d6-f6698448ad29 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.264995 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2feb47a5-cdc0-4bcd-a3d6-f6698448ad29 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.265764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2feb47a5-cdc0-4bcd-a3d6-f6698448ad29 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:35.266192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2feb47a5-cdc0-4bcd-a3d6-f6698448ad29 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:35.404836 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2feb47a5-cdc0-4bcd-a3d6-f6698448ad29 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:35.418978 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2feb47a5-cdc0-4bcd-a3d6-f6698448ad29 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:35.420507 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2feb47a5-cdc0-4bcd-a3d6-f6698448ad29 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:35.421671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2feb47a5-cdc0-4bcd-a3d6-f6698448ad29 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.169396 Jul 25 06:02:35.422222 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 248/502] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:35 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:02:35.555099 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4ae935cc-a9d8-4a01-b37b-c1f7802d4491 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:35.563009 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4ae935cc-a9d8-4a01-b37b-c1f7802d4491 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.395678 Jul 25 06:02:35.563576 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 255/503] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:35 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:36.006211 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8270e1a1-7366-4ca3-bcc5-8415c0ee8bd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:36.006871 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-8270e1a1-7366-4ca3-bcc5-8415c0ee8bd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] [instance: b0f37573-28da-4e81-9d33-c762d63aaa0d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:36.013578 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8270e1a1-7366-4ca3-bcc5-8415c0ee8bd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:36.016362 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8270e1a1-7366-4ca3-bcc5-8415c0ee8bd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:36.016362 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8270e1a1-7366-4ca3-bcc5-8415c0ee8bd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:36.016362 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8270e1a1-7366-4ca3-bcc5-8415c0ee8bd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:36.028870 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-8270e1a1-7366-4ca3-bcc5-8415c0ee8bd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] HTTP exception thrown: Instance b0f37573-28da-4e81-9d33-c762d63aaa0d could not be found. Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8270e1a1-7366-4ca3-bcc5-8415c0ee8bd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Request method failure captured: Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d HTTP/1.1 Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jHUgxLI-s3xDu5sCF3l344KHTlveufkPsmyPU-5RCgy7cCiixQFcpNkMuy931u09wsSZFD_S4en-8MyXaC8Pn20aCfltsY0UN7UsSGYjDPn26HnJM5xgWZwlgircfLfliRl034nVK0Dd3QMpMKZX92ZQAks19yVr2BcHVleWNNELoI Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: f0e6671f7e7e432b92deccdaf094fed4 Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-VolumesNegativeTest-979106099 Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:02:36.030444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f0e6671f7e7e432b92deccdaf094fed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f0e6671f7e7e432b92deccdaf094fed4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f0e6671f7e7e432b92deccdaf094fed4", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f0e6671f7e7e432b92deccdaf094fed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-VolumesNegativeTest-979106099 Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: f0e6671f7e7e432b92deccdaf094fed4 Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-VolumesNegativeTest-979106099 Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-VolumesNegativeTest-979106099-project Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: ff863f4f7a2147239fb491097268c9e8 Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-VolumesNegativeTest-979106099-project Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance b0f37573-28da-4e81-9d33-c762d63aaa0d could not be found. Jul 25 06:02:36.031937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'b0f37573-28da-4e81-9d33-c762d63aaa0d'} Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f37573-28da-4e81-9d33-c762d63aaa0d could not be found. Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:02:36.032764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f37573-28da-4e81-9d33-c762d63aaa0d could not be found. Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f37573-28da-4e81-9d33-c762d63aaa0d could not be found. Jul 25 06:02:36.033965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:02:36.035200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8270e1a1-7366-4ca3-bcc5-8415c0ee8bd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] Returning 404 to user: Instance b0f37573-28da-4e81-9d33-c762d63aaa0d could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:02:36.035200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8270e1a1-7366-4ca3-bcc5-8415c0ee8bd2 tempest-VolumesNegativeTest-979106099 tempest-VolumesNegativeTest-979106099-project] 10.222.0.40 "GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d" status: 404 len: 111 microversion: 2.1 time: 0.029581 Jul 25 06:02:36.035200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 249/504] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:36 2022] GET /compute/v2.1/servers/b0f37573-28da-4e81-9d33-c762d63aaa0d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:02:36.441114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b57f9397-d014-442a-bb1a-8c16f08ca712 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:36.441823 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b57f9397-d014-442a-bb1a-8c16f08ca712 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:36.449752 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b57f9397-d014-442a-bb1a-8c16f08ca712 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:36.449927 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b57f9397-d014-442a-bb1a-8c16f08ca712 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:36.450706 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b57f9397-d014-442a-bb1a-8c16f08ca712 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:36.451143 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b57f9397-d014-442a-bb1a-8c16f08ca712 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:36.580833 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-23214c66-2799-438e-a1b5-f4dbc1d027da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:36.581523 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-23214c66-2799-438e-a1b5-f4dbc1d027da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:36.585151 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b57f9397-d014-442a-bb1a-8c16f08ca712 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:36.589952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-23214c66-2799-438e-a1b5-f4dbc1d027da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:36.590403 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-23214c66-2799-438e-a1b5-f4dbc1d027da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:36.591193 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-23214c66-2799-438e-a1b5-f4dbc1d027da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:36.591627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-23214c66-2799-438e-a1b5-f4dbc1d027da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:36.594919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b57f9397-d014-442a-bb1a-8c16f08ca712 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:36.596476 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b57f9397-d014-442a-bb1a-8c16f08ca712 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:36.598090 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b57f9397-d014-442a-bb1a-8c16f08ca712 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.160775 Jul 25 06:02:36.598903 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 256/505] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:36 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:36.724926 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-23214c66-2799-438e-a1b5-f4dbc1d027da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:36.733766 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-23214c66-2799-438e-a1b5-f4dbc1d027da tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.156778 Jul 25 06:02:36.734508 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 250/506] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:36 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:37.618774 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-981f5e8e-ab6e-4c45-99d7-13fe7d33f76b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:37.620137 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-981f5e8e-ab6e-4c45-99d7-13fe7d33f76b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:37.627559 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-981f5e8e-ab6e-4c45-99d7-13fe7d33f76b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:37.628147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-981f5e8e-ab6e-4c45-99d7-13fe7d33f76b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:37.629159 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-981f5e8e-ab6e-4c45-99d7-13fe7d33f76b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:37.630501 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-981f5e8e-ab6e-4c45-99d7-13fe7d33f76b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:37.750424 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3229a081-29da-4fe8-905b-b151ff3dc5a5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:37.751027 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3229a081-29da-4fe8-905b-b151ff3dc5a5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:37.757804 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3229a081-29da-4fe8-905b-b151ff3dc5a5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:37.758254 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3229a081-29da-4fe8-905b-b151ff3dc5a5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:37.759074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3229a081-29da-4fe8-905b-b151ff3dc5a5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:37.759518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3229a081-29da-4fe8-905b-b151ff3dc5a5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:37.782685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:37.910840 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3229a081-29da-4fe8-905b-b151ff3dc5a5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:37.919823 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3229a081-29da-4fe8-905b-b151ff3dc5a5 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.173283 Jul 25 06:02:37.920424 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 251/507] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:37 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:37.967758 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-981f5e8e-ab6e-4c45-99d7-13fe7d33f76b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:37.976635 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-981f5e8e-ab6e-4c45-99d7-13fe7d33f76b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:37.979824 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-981f5e8e-ab6e-4c45-99d7-13fe7d33f76b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:37.981541 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-981f5e8e-ab6e-4c45-99d7-13fe7d33f76b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.366836 Jul 25 06:02:37.992742 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 257/508] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:37 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:38.629259 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5c4c0>>, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-359809341", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "networks": [{"uuid": "bed4e1ff-978c-499b-96a3-5f6ed76b5a2b"}]}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:38.641561 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:38.687150 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.network.neutron [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] validate_networks() for [('bed4e1ff-978c-499b-96a3-5f6ed76b5a2b', None, None, None, None, None)] {{(pid=124918) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:02:38.937569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-baa12cb8-f346-47c5-b05a-f4b6094bf25b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:38.938648 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-baa12cb8-f346-47c5-b05a-f4b6094bf25b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:38.940579 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:38.941351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=6 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:38.946669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-baa12cb8-f346-47c5-b05a-f4b6094bf25b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:38.947121 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-baa12cb8-f346-47c5-b05a-f4b6094bf25b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:38.947888 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-baa12cb8-f346-47c5-b05a-f4b6094bf25b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:38.948353 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-baa12cb8-f346-47c5-b05a-f4b6094bf25b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:39.086142 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Flavor limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:02:39.087253 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Image limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:02:39.088062 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Flavor pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:02:39.093854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Image pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:02:39.093854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:02:39.099537 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:39.100381 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:39.101407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:39.102012 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:39.117039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-baa12cb8-f346-47c5-b05a-f4b6094bf25b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:39.120977 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Getting quotas for project 7d97f354896a4f1bbef0b4d1e6b99c27. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:02:39.124047 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-baa12cb8-f346-47c5-b05a-f4b6094bf25b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.190437 Jul 25 06:02:39.124646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 258/509] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:38 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:39.125006 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Getting quotas for user 5caf24262d214d9aa8cf9612582154f5 and project 7d97f354896a4f1bbef0b4d1e6b99c27. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:02:39.139608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3dfb6224-32e4-4280-8c20-3c9ccfacdddb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:39.140193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3dfb6224-32e4-4280-8c20-3c9ccfacdddb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:39.141617 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Going to run 1 instances... {{(pid=124918) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:02:39.144029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:02:39.155159 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3dfb6224-32e4-4280-8c20-3c9ccfacdddb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:39.155834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3dfb6224-32e4-4280-8c20-3c9ccfacdddb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:39.158171 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3dfb6224-32e4-4280-8c20-3c9ccfacdddb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:39.158773 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3dfb6224-32e4-4280-8c20-3c9ccfacdddb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:39.280299 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3c21bee7-a6b2-4f6e-b5af-7d1e762ef421 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655385 Jul 25 06:02:39.280956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 252/510] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:02:39.291813 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a8dd7172-30b5-461f-8a86-c7a69f505686 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:39.292443 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a8dd7172-30b5-461f-8a86-c7a69f505686 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:39.311281 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3dfb6224-32e4-4280-8c20-3c9ccfacdddb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:39.323010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3dfb6224-32e4-4280-8c20-3c9ccfacdddb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:39.325046 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3dfb6224-32e4-4280-8c20-3c9ccfacdddb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:39.326591 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3dfb6224-32e4-4280-8c20-3c9ccfacdddb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.200944 Jul 25 06:02:39.327255 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 259/511] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:39 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:39.368322 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a8dd7172-30b5-461f-8a86-c7a69f505686 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:39.373954 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a8dd7172-30b5-461f-8a86-c7a69f505686 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1218 microversion: 2.1 time: 0.086648 Jul 25 06:02:39.374756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 253/512] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:39 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:40.146506 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-eba167ec-40c6-4799-9e05-fb8c935a0de1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:40.147956 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-eba167ec-40c6-4799-9e05-fb8c935a0de1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:40.159082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eba167ec-40c6-4799-9e05-fb8c935a0de1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.159739 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eba167ec-40c6-4799-9e05-fb8c935a0de1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.168539 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eba167ec-40c6-4799-9e05-fb8c935a0de1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.169048 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eba167ec-40c6-4799-9e05-fb8c935a0de1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.351834 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-76d9ca91-0dea-4117-a57d-9ab4ca1e648a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:40.353615 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-76d9ca91-0dea-4117-a57d-9ab4ca1e648a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:40.361347 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-76d9ca91-0dea-4117-a57d-9ab4ca1e648a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.366086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-76d9ca91-0dea-4117-a57d-9ab4ca1e648a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.366086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-76d9ca91-0dea-4117-a57d-9ab4ca1e648a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.366086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-76d9ca91-0dea-4117-a57d-9ab4ca1e648a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.397809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-eba167ec-40c6-4799-9e05-fb8c935a0de1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:40.401022 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-eba167ec-40c6-4799-9e05-fb8c935a0de1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.263313 Jul 25 06:02:40.401591 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 260/513] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:40 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:40.407873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ece11c3d-570c-486b-9096-7e38ff94cd06 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:40.408747 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ece11c3d-570c-486b-9096-7e38ff94cd06 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:40.415960 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ece11c3d-570c-486b-9096-7e38ff94cd06 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.416674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ece11c3d-570c-486b-9096-7e38ff94cd06 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.417733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ece11c3d-570c-486b-9096-7e38ff94cd06 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:40.418314 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ece11c3d-570c-486b-9096-7e38ff94cd06 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:40.494225 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ece11c3d-570c-486b-9096-7e38ff94cd06 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:40.503456 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ece11c3d-570c-486b-9096-7e38ff94cd06 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1222 microversion: 2.1 time: 0.099644 Jul 25 06:02:40.504584 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 261/514] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:40 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:40.584554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-76d9ca91-0dea-4117-a57d-9ab4ca1e648a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:40.594551 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-76d9ca91-0dea-4117-a57d-9ab4ca1e648a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:40.596499 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-76d9ca91-0dea-4117-a57d-9ab4ca1e648a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:40.597880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-76d9ca91-0dea-4117-a57d-9ab4ca1e648a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.256276 Jul 25 06:02:40.598848 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 254/515] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:40 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:41.419590 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9862095c-ade8-4ff3-b1dc-05a51cd5670e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:41.420913 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9862095c-ade8-4ff3-b1dc-05a51cd5670e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:41.427561 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9862095c-ade8-4ff3-b1dc-05a51cd5670e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.428014 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9862095c-ade8-4ff3-b1dc-05a51cd5670e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.428823 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9862095c-ade8-4ff3-b1dc-05a51cd5670e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.429398 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9862095c-ade8-4ff3-b1dc-05a51cd5670e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.523063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-623c0f6c-b226-41e8-a876-6900fa501dc2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:41.525681 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-623c0f6c-b226-41e8-a876-6900fa501dc2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:41.541224 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-623c0f6c-b226-41e8-a876-6900fa501dc2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.543340 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-623c0f6c-b226-41e8-a876-6900fa501dc2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.546410 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-623c0f6c-b226-41e8-a876-6900fa501dc2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.547127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-623c0f6c-b226-41e8-a876-6900fa501dc2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.628736 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9862095c-ade8-4ff3-b1dc-05a51cd5670e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:41.637817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9862095c-ade8-4ff3-b1dc-05a51cd5670e tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.221762 Jul 25 06:02:41.640617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 262/516] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:41 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:41.643806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-623c0f6c-b226-41e8-a876-6900fa501dc2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:41.651679 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-623c0f6c-b226-41e8-a876-6900fa501dc2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1222 microversion: 2.1 time: 0.134301 Jul 25 06:02:41.652587 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 255/517] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:41 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:41.653183 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1009994b-f261-41b0-bc05-a7424f0e7f57 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:41.653801 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1009994b-f261-41b0-bc05-a7424f0e7f57 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:41.659894 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1009994b-f261-41b0-bc05-a7424f0e7f57 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.660584 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1009994b-f261-41b0-bc05-a7424f0e7f57 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.661527 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1009994b-f261-41b0-bc05-a7424f0e7f57 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:41.662113 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1009994b-f261-41b0-bc05-a7424f0e7f57 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:41.863410 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1009994b-f261-41b0-bc05-a7424f0e7f57 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:41.877438 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1009994b-f261-41b0-bc05-a7424f0e7f57 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:41.879213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1009994b-f261-41b0-bc05-a7424f0e7f57 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:41.880665 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1009994b-f261-41b0-bc05-a7424f0e7f57 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.238736 Jul 25 06:02:41.882402 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 263/518] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:41 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:42.657106 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-517ffe54-42cc-4b59-81e2-13fc5b95e8ce tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:42.657662 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-517ffe54-42cc-4b59-81e2-13fc5b95e8ce tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:42.664076 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-517ffe54-42cc-4b59-81e2-13fc5b95e8ce tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.664547 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-517ffe54-42cc-4b59-81e2-13fc5b95e8ce tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:42.665501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-517ffe54-42cc-4b59-81e2-13fc5b95e8ce tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.666127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-517ffe54-42cc-4b59-81e2-13fc5b95e8ce tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:42.669034 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-fab56331-70c4-48d7-bd27-a06efffe67e6 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:42.676297 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-fab56331-70c4-48d7-bd27-a06efffe67e6 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:42.676795 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fab56331-70c4-48d7-bd27-a06efffe67e6 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.676924 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fab56331-70c4-48d7-bd27-a06efffe67e6 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:42.677708 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fab56331-70c4-48d7-bd27-a06efffe67e6 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.678171 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fab56331-70c4-48d7-bd27-a06efffe67e6 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:42.786118 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-fab56331-70c4-48d7-bd27-a06efffe67e6 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:42.795011 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-fab56331-70c4-48d7-bd27-a06efffe67e6 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1222 microversion: 2.1 time: 0.130547 Jul 25 06:02:42.795593 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 264/519] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:42 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:42.858507 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-517ffe54-42cc-4b59-81e2-13fc5b95e8ce tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:42.867447 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-517ffe54-42cc-4b59-81e2-13fc5b95e8ce tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.214309 Jul 25 06:02:42.868349 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 256/520] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:42 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:42.904074 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e145ddd7-ff35-48a9-8c99-78398eb60c8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:42.904729 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e145ddd7-ff35-48a9-8c99-78398eb60c8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:42.911111 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e145ddd7-ff35-48a9-8c99-78398eb60c8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.911559 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e145ddd7-ff35-48a9-8c99-78398eb60c8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:42.912395 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e145ddd7-ff35-48a9-8c99-78398eb60c8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:42.912833 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e145ddd7-ff35-48a9-8c99-78398eb60c8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:43.078073 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e145ddd7-ff35-48a9-8c99-78398eb60c8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:43.088185 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e145ddd7-ff35-48a9-8c99-78398eb60c8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:43.089972 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e145ddd7-ff35-48a9-8c99-78398eb60c8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:43.091150 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e145ddd7-ff35-48a9-8c99-78398eb60c8d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.192213 Jul 25 06:02:43.091707 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 265/521] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:42 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:43.813037 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ea07ef98-ec72-4459-8ed0-fd0b160d329b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:43.813965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ea07ef98-ec72-4459-8ed0-fd0b160d329b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:43.825031 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea07ef98-ec72-4459-8ed0-fd0b160d329b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:43.825547 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea07ef98-ec72-4459-8ed0-fd0b160d329b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:43.826724 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea07ef98-ec72-4459-8ed0-fd0b160d329b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:43.827064 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea07ef98-ec72-4459-8ed0-fd0b160d329b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:43.880958 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-81cce4fc-b66b-4e36-a23c-4c7dff42e35e req-21a0756e-2f84-45ac-9750-514c4f901c3c service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "65bf5eef-5bf1-458e-bed9-c7184fc1f2e2", "name": "network-vif-plugged", "status": "completed", "tag": "f2d5059f-ba0a-49d2-b470-adede8bbdc2e"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:43.892820 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-81cce4fc-b66b-4e36-a23c-4c7dff42e35e req-21a0756e-2f84-45ac-9750-514c4f901c3c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:43.893261 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-81cce4fc-b66b-4e36-a23c-4c7dff42e35e req-21a0756e-2f84-45ac-9750-514c4f901c3c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:43.904937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-81cce4fc-b66b-4e36-a23c-4c7dff42e35e req-21a0756e-2f84-45ac-9750-514c4f901c3c service nova] Creating event network-vif-plugged:f2d5059f-ba0a-49d2-b470-adede8bbdc2e for instance 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 on hv-cinder-84841 Jul 25 06:02:43.909122 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ea07ef98-ec72-4459-8ed0-fd0b160d329b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:43.911088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-81cce4fc-b66b-4e36-a23c-4c7dff42e35e req-21a0756e-2f84-45ac-9750-514c4f901c3c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035419 Jul 25 06:02:43.912091 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 266/522] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:02:43.918877 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-330e095f-3374-4e66-a4b9-32ec77c17241 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:43.919809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-330e095f-3374-4e66-a4b9-32ec77c17241 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:43.924764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ea07ef98-ec72-4459-8ed0-fd0b160d329b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1222 microversion: 2.1 time: 0.112818 Jul 25 06:02:43.925545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 257/523] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:43 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:43.929623 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-330e095f-3374-4e66-a4b9-32ec77c17241 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:43.929623 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-330e095f-3374-4e66-a4b9-32ec77c17241 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:43.932712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-330e095f-3374-4e66-a4b9-32ec77c17241 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:43.933446 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-330e095f-3374-4e66-a4b9-32ec77c17241 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:44.110572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d1b6688f-4ab1-4471-82c4-02a796bfc277 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:44.111226 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d1b6688f-4ab1-4471-82c4-02a796bfc277 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:44.118209 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d1b6688f-4ab1-4471-82c4-02a796bfc277 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:44.121864 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d1b6688f-4ab1-4471-82c4-02a796bfc277 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:44.121864 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d1b6688f-4ab1-4471-82c4-02a796bfc277 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:44.121864 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d1b6688f-4ab1-4471-82c4-02a796bfc277 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:44.162080 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-330e095f-3374-4e66-a4b9-32ec77c17241 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:44.170760 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-330e095f-3374-4e66-a4b9-32ec77c17241 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.257286 Jul 25 06:02:44.171371 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 267/524] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:43 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:44.280070 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d1b6688f-4ab1-4471-82c4-02a796bfc277 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:44.293018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d1b6688f-4ab1-4471-82c4-02a796bfc277 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:44.296354 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d1b6688f-4ab1-4471-82c4-02a796bfc277 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:44.297722 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d1b6688f-4ab1-4471-82c4-02a796bfc277 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.191480 Jul 25 06:02:44.298433 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 258/525] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:44 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:02:44.942611 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-34324cfb-fe3d-4f02-a3c3-8390d45b7c9f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:44.945042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-34324cfb-fe3d-4f02-a3c3-8390d45b7c9f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:44.951038 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34324cfb-fe3d-4f02-a3c3-8390d45b7c9f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:44.951490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34324cfb-fe3d-4f02-a3c3-8390d45b7c9f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:44.952296 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34324cfb-fe3d-4f02-a3c3-8390d45b7c9f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:44.952734 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34324cfb-fe3d-4f02-a3c3-8390d45b7c9f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:45.016139 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-34324cfb-fe3d-4f02-a3c3-8390d45b7c9f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:45.027314 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-34324cfb-fe3d-4f02-a3c3-8390d45b7c9f tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1222 microversion: 2.1 time: 0.088148 Jul 25 06:02:45.028282 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 268/526] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:44 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:45.189151 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b146d567-0ad7-4e3b-8b2d-144ed43506e2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:45.189757 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b146d567-0ad7-4e3b-8b2d-144ed43506e2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:45.208002 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b146d567-0ad7-4e3b-8b2d-144ed43506e2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:45.213727 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b146d567-0ad7-4e3b-8b2d-144ed43506e2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:45.213727 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b146d567-0ad7-4e3b-8b2d-144ed43506e2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:45.213727 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b146d567-0ad7-4e3b-8b2d-144ed43506e2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:45.321751 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-47210a15-9180-4e7a-b24f-17b58ec74154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:45.323280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-47210a15-9180-4e7a-b24f-17b58ec74154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:45.329972 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-47210a15-9180-4e7a-b24f-17b58ec74154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:45.330668 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-47210a15-9180-4e7a-b24f-17b58ec74154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:45.331777 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-47210a15-9180-4e7a-b24f-17b58ec74154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:45.332918 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-47210a15-9180-4e7a-b24f-17b58ec74154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:45.428303 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b146d567-0ad7-4e3b-8b2d-144ed43506e2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:45.439220 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b146d567-0ad7-4e3b-8b2d-144ed43506e2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.253242 Jul 25 06:02:45.441073 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 259/527] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:45 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:45.516016 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-47210a15-9180-4e7a-b24f-17b58ec74154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:45.529938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-47210a15-9180-4e7a-b24f-17b58ec74154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:45.532093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-47210a15-9180-4e7a-b24f-17b58ec74154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:45.533904 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-47210a15-9180-4e7a-b24f-17b58ec74154 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.220557 Jul 25 06:02:45.535702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 269/528] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:45 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:02:46.044457 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4d603587-6c88-4b5f-bf78-2931622e0988 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:46.045165 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4d603587-6c88-4b5f-bf78-2931622e0988 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:46.054920 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4d603587-6c88-4b5f-bf78-2931622e0988 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:46.055466 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4d603587-6c88-4b5f-bf78-2931622e0988 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:46.057057 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4d603587-6c88-4b5f-bf78-2931622e0988 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:46.057743 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4d603587-6c88-4b5f-bf78-2931622e0988 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:46.194944 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4d603587-6c88-4b5f-bf78-2931622e0988 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:46.207055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4d603587-6c88-4b5f-bf78-2931622e0988 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1222 microversion: 2.1 time: 0.166642 Jul 25 06:02:46.207879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 260/529] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:46 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:46.470436 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-74ebbedf-4658-47b8-9d92-489367eff9c1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:46.471214 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-74ebbedf-4658-47b8-9d92-489367eff9c1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:46.484705 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-74ebbedf-4658-47b8-9d92-489367eff9c1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:46.487940 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-74ebbedf-4658-47b8-9d92-489367eff9c1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:46.489376 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-74ebbedf-4658-47b8-9d92-489367eff9c1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:46.490033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-74ebbedf-4658-47b8-9d92-489367eff9c1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:46.554973 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-33085cce-2135-4134-822f-61bc65c4f0f6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:46.555841 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-33085cce-2135-4134-822f-61bc65c4f0f6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:46.566329 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-33085cce-2135-4134-822f-61bc65c4f0f6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:46.570987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-33085cce-2135-4134-822f-61bc65c4f0f6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:46.575565 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-33085cce-2135-4134-822f-61bc65c4f0f6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:46.576250 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-33085cce-2135-4134-822f-61bc65c4f0f6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:46.724961 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-74ebbedf-4658-47b8-9d92-489367eff9c1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:46.734537 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-74ebbedf-4658-47b8-9d92-489367eff9c1 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.268690 Jul 25 06:02:46.735120 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 270/530] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:46 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:46.815992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-33085cce-2135-4134-822f-61bc65c4f0f6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:46.828737 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-33085cce-2135-4134-822f-61bc65c4f0f6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:46.830258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-33085cce-2135-4134-822f-61bc65c4f0f6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:46.832314 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-33085cce-2135-4134-822f-61bc65c4f0f6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.281381 Jul 25 06:02:46.833054 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 261/531] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:46 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:47.225132 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-11f02920-41fc-42a0-bec3-32910b571db2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:47.225880 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-11f02920-41fc-42a0-bec3-32910b571db2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:47.233099 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-11f02920-41fc-42a0-bec3-32910b571db2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.233628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-11f02920-41fc-42a0-bec3-32910b571db2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.234470 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-11f02920-41fc-42a0-bec3-32910b571db2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.234978 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-11f02920-41fc-42a0-bec3-32910b571db2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.262297 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:47.329191 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-11f02920-41fc-42a0-bec3-32910b571db2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:47.336830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-11f02920-41fc-42a0-bec3-32910b571db2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1222 microversion: 2.1 time: 0.116407 Jul 25 06:02:47.338069 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 271/532] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:47 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:47.753210 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1844c0aa-34f4-4aec-9569-7a81360472ab tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:47.754737 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1844c0aa-34f4-4aec-9569-7a81360472ab tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:47.763923 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1844c0aa-34f4-4aec-9569-7a81360472ab tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.764960 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1844c0aa-34f4-4aec-9569-7a81360472ab tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.765908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1844c0aa-34f4-4aec-9569-7a81360472ab tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.766498 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1844c0aa-34f4-4aec-9569-7a81360472ab tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.852704 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f93f3cef-408e-46d1-a902-b082f0befab9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:47.854276 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f93f3cef-408e-46d1-a902-b082f0befab9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:47.861323 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f93f3cef-408e-46d1-a902-b082f0befab9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.861775 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f93f3cef-408e-46d1-a902-b082f0befab9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.862554 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f93f3cef-408e-46d1-a902-b082f0befab9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:47.863054 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f93f3cef-408e-46d1-a902-b082f0befab9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:47.965397 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1844c0aa-34f4-4aec-9569-7a81360472ab tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:47.973706 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1844c0aa-34f4-4aec-9569-7a81360472ab tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.224918 Jul 25 06:02:47.974421 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 262/533] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:47 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:48.122664 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f93f3cef-408e-46d1-a902-b082f0befab9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:48.131536 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f93f3cef-408e-46d1-a902-b082f0befab9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:48.133110 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f93f3cef-408e-46d1-a902-b082f0befab9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:48.134981 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f93f3cef-408e-46d1-a902-b082f0befab9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.287457 Jul 25 06:02:48.145665 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 272/534] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:47 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:48.353830 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f7b27531-1f13-4b57-b02c-1f17962af4ad tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:48.354757 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f7b27531-1f13-4b57-b02c-1f17962af4ad tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:48.366576 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f7b27531-1f13-4b57-b02c-1f17962af4ad tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:48.367117 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f7b27531-1f13-4b57-b02c-1f17962af4ad tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:48.367968 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f7b27531-1f13-4b57-b02c-1f17962af4ad tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:48.369023 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f7b27531-1f13-4b57-b02c-1f17962af4ad tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:48.466073 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f7b27531-1f13-4b57-b02c-1f17962af4ad tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:48.474215 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f7b27531-1f13-4b57-b02c-1f17962af4ad tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1222 microversion: 2.1 time: 0.124376 Jul 25 06:02:48.475383 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 263/535] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:48 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:48.991480 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-21cbb80a-64ec-4048-9e00-c0524900cee2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:48.992191 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-21cbb80a-64ec-4048-9e00-c0524900cee2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:49.000412 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-21cbb80a-64ec-4048-9e00-c0524900cee2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.000956 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-21cbb80a-64ec-4048-9e00-c0524900cee2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.001769 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-21cbb80a-64ec-4048-9e00-c0524900cee2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.002289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-21cbb80a-64ec-4048-9e00-c0524900cee2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.156690 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8e76589e-d9c3-47f5-9606-0d881b3358b8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:49.189851 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-8e76589e-d9c3-47f5-9606-0d881b3358b8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:49.189851 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:49.189851 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8e76589e-d9c3-47f5-9606-0d881b3358b8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.189851 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8e76589e-d9c3-47f5-9606-0d881b3358b8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.190505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8e76589e-d9c3-47f5-9606-0d881b3358b8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.190505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8e76589e-d9c3-47f5-9606-0d881b3358b8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.277314 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-21cbb80a-64ec-4048-9e00-c0524900cee2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:49.289367 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-21cbb80a-64ec-4048-9e00-c0524900cee2 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.301958 Jul 25 06:02:49.289959 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 273/536] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:48 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:49.359229 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8e76589e-d9c3-47f5-9606-0d881b3358b8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:49.373885 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8e76589e-d9c3-47f5-9606-0d881b3358b8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:49.385810 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8e76589e-d9c3-47f5-9606-0d881b3358b8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:49.387671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8e76589e-d9c3-47f5-9606-0d881b3358b8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.238022 Jul 25 06:02:49.391579 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 264/537] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:49 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:49.492207 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6300de3f-7959-49a4-8c13-47b6abd1c965 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:49.492861 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6300de3f-7959-49a4-8c13-47b6abd1c965 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:49.500264 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6300de3f-7959-49a4-8c13-47b6abd1c965 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.502836 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6300de3f-7959-49a4-8c13-47b6abd1c965 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.502836 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6300de3f-7959-49a4-8c13-47b6abd1c965 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:49.502836 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6300de3f-7959-49a4-8c13-47b6abd1c965 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:49.610796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6300de3f-7959-49a4-8c13-47b6abd1c965 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:49.619584 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6300de3f-7959-49a4-8c13-47b6abd1c965 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1222 microversion: 2.1 time: 0.130807 Jul 25 06:02:49.623316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 274/538] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:49 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:50.307773 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7bc30a6c-f8de-4b55-b7df-0a4403bc080d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:50.308416 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7bc30a6c-f8de-4b55-b7df-0a4403bc080d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:50.310331 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=8 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:50.326938 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bc30a6c-f8de-4b55-b7df-0a4403bc080d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.327605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bc30a6c-f8de-4b55-b7df-0a4403bc080d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.328616 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bc30a6c-f8de-4b55-b7df-0a4403bc080d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.329210 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bc30a6c-f8de-4b55-b7df-0a4403bc080d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.411208 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e5b0d60b-db24-47b7-8016-9df1eba80727 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:50.412572 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e5b0d60b-db24-47b7-8016-9df1eba80727 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:50.438613 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5b0d60b-db24-47b7-8016-9df1eba80727 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.443034 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5b0d60b-db24-47b7-8016-9df1eba80727 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.444861 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5b0d60b-db24-47b7-8016-9df1eba80727 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.448075 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5b0d60b-db24-47b7-8016-9df1eba80727 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.860056 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e5b0d60b-db24-47b7-8016-9df1eba80727 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:50.872317 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e5b0d60b-db24-47b7-8016-9df1eba80727 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:50.873914 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e5b0d60b-db24-47b7-8016-9df1eba80727 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:50.875094 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e5b0d60b-db24-47b7-8016-9df1eba80727 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.468562 Jul 25 06:02:50.880209 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 275/539] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:50 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:50.882447 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9110525b-a283-46a4-8aca-ce36f0b5f149 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:50.883222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9110525b-a283-46a4-8aca-ce36f0b5f149 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:50.893837 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9110525b-a283-46a4-8aca-ce36f0b5f149 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.894278 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9110525b-a283-46a4-8aca-ce36f0b5f149 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.895304 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9110525b-a283-46a4-8aca-ce36f0b5f149 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:50.895735 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9110525b-a283-46a4-8aca-ce36f0b5f149 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:50.942984 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7bc30a6c-f8de-4b55-b7df-0a4403bc080d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:50.951559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7bc30a6c-f8de-4b55-b7df-0a4403bc080d tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.648958 Jul 25 06:02:50.952717 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 265/540] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:50 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:50.970233 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9110525b-a283-46a4-8aca-ce36f0b5f149 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:50.977675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9110525b-a283-46a4-8aca-ce36f0b5f149 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1222 microversion: 2.1 time: 0.100991 Jul 25 06:02:50.978775 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 276/541] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:50 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:51.895232 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4ded512f-7635-43bb-bf42-6c264be776cc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:51.895824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4ded512f-7635-43bb-bf42-6c264be776cc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:51.903273 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4ded512f-7635-43bb-bf42-6c264be776cc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:51.903714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4ded512f-7635-43bb-bf42-6c264be776cc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:51.904499 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4ded512f-7635-43bb-bf42-6c264be776cc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:51.904925 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4ded512f-7635-43bb-bf42-6c264be776cc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:51.970354 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0007edc2-e4d2-4de2-9bd3-fbc598773f76 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:51.971040 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0007edc2-e4d2-4de2-9bd3-fbc598773f76 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:51.980884 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0007edc2-e4d2-4de2-9bd3-fbc598773f76 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:51.981405 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0007edc2-e4d2-4de2-9bd3-fbc598773f76 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:51.982248 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0007edc2-e4d2-4de2-9bd3-fbc598773f76 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:51.982797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0007edc2-e4d2-4de2-9bd3-fbc598773f76 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:52.111205 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4ded512f-7635-43bb-bf42-6c264be776cc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:52.124635 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4ded512f-7635-43bb-bf42-6c264be776cc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:52.126478 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4ded512f-7635-43bb-bf42-6c264be776cc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:52.127955 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4ded512f-7635-43bb-bf42-6c264be776cc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.236873 Jul 25 06:02:52.139449 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0007edc2-e4d2-4de2-9bd3-fbc598773f76 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:52.139781 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 266/542] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:51 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:52.144977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0007edc2-e4d2-4de2-9bd3-fbc598773f76 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.178976 Jul 25 06:02:52.145160 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-72949cac-3907-419d-a9d3-24f8f4406f59 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:52.146979 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 277/543] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:51 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:52.147096 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-72949cac-3907-419d-a9d3-24f8f4406f59 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:52.153909 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-72949cac-3907-419d-a9d3-24f8f4406f59 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:52.160027 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-72949cac-3907-419d-a9d3-24f8f4406f59 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:52.160027 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-72949cac-3907-419d-a9d3-24f8f4406f59 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:52.160027 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-72949cac-3907-419d-a9d3-24f8f4406f59 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:52.218197 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-72949cac-3907-419d-a9d3-24f8f4406f59 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:52.225567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-72949cac-3907-419d-a9d3-24f8f4406f59 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1214 microversion: 2.1 time: 0.084401 Jul 25 06:02:52.226135 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 267/544] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:52 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:53.147764 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ef7d7178-9c23-46fb-b940-5244842d0e5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:53.148473 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ef7d7178-9c23-46fb-b940-5244842d0e5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:53.157220 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ef7d7178-9c23-46fb-b940-5244842d0e5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.157884 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ef7d7178-9c23-46fb-b940-5244842d0e5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.160277 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ef7d7178-9c23-46fb-b940-5244842d0e5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.160879 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ef7d7178-9c23-46fb-b940-5244842d0e5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.170513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-26246d2d-3a6a-4cf0-b8a9-1524c1a65b96 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:53.171137 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-26246d2d-3a6a-4cf0-b8a9-1524c1a65b96 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:53.185878 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-26246d2d-3a6a-4cf0-b8a9-1524c1a65b96 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.186217 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-26246d2d-3a6a-4cf0-b8a9-1524c1a65b96 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.188427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-26246d2d-3a6a-4cf0-b8a9-1524c1a65b96 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.189625 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-26246d2d-3a6a-4cf0-b8a9-1524c1a65b96 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.379414 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-26246d2d-3a6a-4cf0-b8a9-1524c1a65b96 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:53.389775 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-26246d2d-3a6a-4cf0-b8a9-1524c1a65b96 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1313 microversion: 2.1 time: 0.228380 Jul 25 06:02:53.390365 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 268/545] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:53 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:53.395698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a656eb97-b1e4-4d60-bfb4-4c42643dcaa5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:53.396542 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a656eb97-b1e4-4d60-bfb4-4c42643dcaa5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:53.405536 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a656eb97-b1e4-4d60-bfb4-4c42643dcaa5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.405979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a656eb97-b1e4-4d60-bfb4-4c42643dcaa5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.406834 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a656eb97-b1e4-4d60-bfb4-4c42643dcaa5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.407265 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a656eb97-b1e4-4d60-bfb4-4c42643dcaa5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.438560 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ef7d7178-9c23-46fb-b940-5244842d0e5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:53.453820 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ef7d7178-9c23-46fb-b940-5244842d0e5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:53.455679 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ef7d7178-9c23-46fb-b940-5244842d0e5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:53.457353 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ef7d7178-9c23-46fb-b940-5244842d0e5e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.314110 Jul 25 06:02:53.458092 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 278/546] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:53 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:53.526133 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a656eb97-b1e4-4d60-bfb4-4c42643dcaa5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:53.530736 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=100 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:53.536708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a656eb97-b1e4-4d60-bfb4-4c42643dcaa5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1270 microversion: 2.1 time: 0.144200 Jul 25 06:02:53.539963 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 269/547] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:53 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:53.777265 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e0c8acb8-ec18-4637-a786-2432d0c859c7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f1c0>>, body: {"volumeAttachment": {"volumeId": "2d82e4b9-5a46-49a2-b9a1-3625c146b23d"}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:53.779240 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e0c8acb8-ec18-4637-a786-2432d0c859c7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:53.788472 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e0c8acb8-ec18-4637-a786-2432d0c859c7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.789168 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e0c8acb8-ec18-4637-a786-2432d0c859c7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:53.797610 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e0c8acb8-ec18-4637-a786-2432d0c859c7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:53.798789 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e0c8acb8-ec18-4637-a786-2432d0c859c7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.428243 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c9ec0a1b-9544-4791-bfc7-532a02a97b0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:54.430349 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c9ec0a1b-9544-4791-bfc7-532a02a97b0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:54.452618 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9ec0a1b-9544-4791-bfc7-532a02a97b0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.453701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9ec0a1b-9544-4791-bfc7-532a02a97b0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.458671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9ec0a1b-9544-4791-bfc7-532a02a97b0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.459125 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9ec0a1b-9544-4791-bfc7-532a02a97b0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.789567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c9ec0a1b-9544-4791-bfc7-532a02a97b0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:54.800714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c9ec0a1b-9544-4791-bfc7-532a02a97b0a tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1496 microversion: 2.1 time: 0.389868 Jul 25 06:02:54.811896 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 270/548] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:54 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1496 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:54.826056 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e0c8acb8-ec18-4637-a786-2432d0c859c7 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "POST /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.043032 Jul 25 06:02:54.827572 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 279/549] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:02:53 2022] POST /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-volume_attachments => generated 194 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:02:54.828143 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-61c224ad-13b5-4e93-a381-ab2d4f7a9108 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:54.829047 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-61c224ad-13b5-4e93-a381-ab2d4f7a9108 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:54.837978 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-61c224ad-13b5-4e93-a381-ab2d4f7a9108 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.838626 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-61c224ad-13b5-4e93-a381-ab2d4f7a9108 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.839915 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-61c224ad-13b5-4e93-a381-ab2d4f7a9108 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.840701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-61c224ad-13b5-4e93-a381-ab2d4f7a9108 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.852869 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-67dba091-9b70-4c4c-b244-a67eecf492fe tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:54.854585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-67dba091-9b70-4c4c-b244-a67eecf492fe tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:54.873143 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:54.878563 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-67dba091-9b70-4c4c-b244-a67eecf492fe tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.879551 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-67dba091-9b70-4c4c-b244-a67eecf492fe tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:54.881834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-67dba091-9b70-4c4c-b244-a67eecf492fe tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:54.887179 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-67dba091-9b70-4c4c-b244-a67eecf492fe tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:55.003567 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-67dba091-9b70-4c4c-b244-a67eecf492fe tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:55.012717 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-67dba091-9b70-4c4c-b244-a67eecf492fe tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1276 microversion: 2.1 time: 0.183400 Jul 25 06:02:55.013852 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 280/550] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:54 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:55.058131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-61c224ad-13b5-4e93-a381-ab2d4f7a9108 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:55.072475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-61c224ad-13b5-4e93-a381-ab2d4f7a9108 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:55.072475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-61c224ad-13b5-4e93-a381-ab2d4f7a9108 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:55.073893 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-61c224ad-13b5-4e93-a381-ab2d4f7a9108 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.260906 Jul 25 06:02:55.074782 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 271/551] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:54 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:55.882542 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d59a7a18-2dcd-43d6-8a96-6b6f7604bc5b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:55.883085 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d59a7a18-2dcd-43d6-8a96-6b6f7604bc5b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:55.890501 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d59a7a18-2dcd-43d6-8a96-6b6f7604bc5b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:55.890961 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d59a7a18-2dcd-43d6-8a96-6b6f7604bc5b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:55.892091 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d59a7a18-2dcd-43d6-8a96-6b6f7604bc5b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:55.892574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d59a7a18-2dcd-43d6-8a96-6b6f7604bc5b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:55.925512 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d59a7a18-2dcd-43d6-8a96-6b6f7604bc5b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Going to try to terminate instance {{(pid=124917) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:02:56.062682 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e5a3a46a-b8b6-46e7-a3af-138651cb9484 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method IPsController.index of <nova.api.openstack.compute.ips.IPsController object at 0x7f6533ee6fa0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:56.064172 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e5a3a46a-b8b6-46e7-a3af-138651cb9484 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:56.073301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5a3a46a-b8b6-46e7-a3af-138651cb9484 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.074213 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5a3a46a-b8b6-46e7-a3af-138651cb9484 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.075318 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5a3a46a-b8b6-46e7-a3af-138651cb9484 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.075944 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5a3a46a-b8b6-46e7-a3af-138651cb9484 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.103766 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e5a3a46a-b8b6-46e7-a3af-138651cb9484 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356/ips" status: 200 len: 149 microversion: 2.1 time: 0.046921 Jul 25 06:02:56.111560 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 272/552] 10.222.0.40 () {58 vars in 1247 bytes} [Mon Jul 25 06:02:56 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:02:56.116020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3c2a8835-06b5-4be5-bd62-ef3791b37e8c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:56.116878 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3c2a8835-06b5-4be5-bd62-ef3791b37e8c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:56.124316 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3c2a8835-06b5-4be5-bd62-ef3791b37e8c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.124846 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3c2a8835-06b5-4be5-bd62-ef3791b37e8c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.125686 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3c2a8835-06b5-4be5-bd62-ef3791b37e8c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.126180 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3c2a8835-06b5-4be5-bd62-ef3791b37e8c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.272585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d59a7a18-2dcd-43d6-8a96-6b6f7604bc5b tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "DELETE /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 204 len: 0 microversion: 2.1 time: 0.394022 Jul 25 06:02:56.273185 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 281/553] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:02:55 2022] DELETE /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:02:56.282211 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-fc70875e-a374-4517-806d-21ecb56203c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:56.288788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-fc70875e-a374-4517-806d-21ecb56203c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:56.309775 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fc70875e-a374-4517-806d-21ecb56203c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.310151 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fc70875e-a374-4517-806d-21ecb56203c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.311699 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fc70875e-a374-4517-806d-21ecb56203c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.313126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fc70875e-a374-4517-806d-21ecb56203c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.328714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3c2a8835-06b5-4be5-bd62-ef3791b37e8c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:56.342019 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3c2a8835-06b5-4be5-bd62-ef3791b37e8c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.232296 Jul 25 06:02:56.343780 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 273/554] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:56 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:56.360952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ea369aca-785f-49a3-9e0f-b921dd134491 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f190>>, body: {"volumeAttachment": {"volumeId": "e5b9fbc3-bd4e-4941-bb6f-b015f283d330"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:56.363035 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ea369aca-785f-49a3-9e0f-b921dd134491 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:56.370612 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea369aca-785f-49a3-9e0f-b921dd134491 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.371243 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea369aca-785f-49a3-9e0f-b921dd134491 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.372369 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea369aca-785f-49a3-9e0f-b921dd134491 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.372956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea369aca-785f-49a3-9e0f-b921dd134491 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.467167 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-ea369aca-785f-49a3-9e0f-b921dd134491 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Invalid volume: volume e5b9fbc3-bd4e-4941-bb6f-b015f283d330 is already attached to instances: efb335ec-f540-494a-a2c7-c8db2f467c02 Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ea369aca-785f-49a3-9e0f-b921dd134491 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: POST /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356/os-volume_attachments HTTP/1.1 Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 74 Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:02:56.468815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {"volumeAttachment": {"volumeId": "e5b9fbc3-bd4e-4941-bb6f-b015f283d330"}} Jul 25 06:02:56.470218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f190>> Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Invalid volume: volume e5b9fbc3-bd4e-4941-bb6f-b015f283d330 is already attached to instances: efb335ec-f540-494a-a2c7-c8db2f467c02 Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'server_id': 'cffe93da-af1c-417f-8b03-0d6262028356', 'body': {'volumeAttachment': {'volumeId': 'e5b9fbc3-bd4e-4941-bb6f-b015f283d330'}}} Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e5b9fbc3-bd4e-4941-bb6f-b015f283d330 is already attached to instances: efb335ec-f540-494a-a2c7-c8db2f467c02 Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:02:56.470945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e5b9fbc3-bd4e-4941-bb6f-b015f283d330 is already attached to instances: efb335ec-f540-494a-a2c7-c8db2f467c02 Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:02:56.472094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:02:56.473307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:02:56.473307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:02:56.473307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:02:56.473307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e5b9fbc3-bd4e-4941-bb6f-b015f283d330 is already attached to instances: efb335ec-f540-494a-a2c7-c8db2f467c02 Jul 25 06:02:56.473307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:02:56.473307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ea369aca-785f-49a3-9e0f-b921dd134491 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 400 to user: Invalid volume: volume e5b9fbc3-bd4e-4941-bb6f-b015f283d330 is already attached to instances: efb335ec-f540-494a-a2c7-c8db2f467c02 {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:02:56.473307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ea369aca-785f-49a3-9e0f-b921dd134491 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.124934 Jul 25 06:02:56.473307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 274/555] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:02:56 2022] POST /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:02:56.475858 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f51bca23-d083-4a2d-a368-47e6de944514 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:56.476668 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f51bca23-d083-4a2d-a368-47e6de944514 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:56.484081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f51bca23-d083-4a2d-a368-47e6de944514 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.484859 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f51bca23-d083-4a2d-a368-47e6de944514 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.485846 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f51bca23-d083-4a2d-a368-47e6de944514 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.486288 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f51bca23-d083-4a2d-a368-47e6de944514 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.612452 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-fc70875e-a374-4517-806d-21ecb56203c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:56.628019 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-fc70875e-a374-4517-806d-21ecb56203c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:56.629626 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-fc70875e-a374-4517-806d-21ecb56203c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:56.630717 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-fc70875e-a374-4517-806d-21ecb56203c7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.356454 Jul 25 06:02:56.631277 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 282/556] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:56 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:56.648533 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9353584d-474e-4d89-a6c1-c196d20f7f56 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:56.649026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9353584d-474e-4d89-a6c1-c196d20f7f56 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:56.655079 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9353584d-474e-4d89-a6c1-c196d20f7f56 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.655911 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9353584d-474e-4d89-a6c1-c196d20f7f56 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.656325 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9353584d-474e-4d89-a6c1-c196d20f7f56 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.656915 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9353584d-474e-4d89-a6c1-c196d20f7f56 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.657166 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f51bca23-d083-4a2d-a368-47e6de944514 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:56.668276 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f51bca23-d083-4a2d-a368-47e6de944514 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1502 microversion: 2.1 time: 0.196449 Jul 25 06:02:56.669029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 275/557] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:56 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:56.685314 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9353584d-474e-4d89-a6c1-c196d20f7f56 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Going to try to terminate instance {{(pid=124917) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:02:56.746318 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-48fe5cc8-2260-45d0-b201-0a18c49ca30d req-90bc0cb1-d727-439c-b968-53e2c5465850 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "33c564d4-6300-4c60-8829-01e8f445ce7a", "tag": "38ff92c0-a00a-47e1-8c8a-767f34ecb3de"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:02:56.755554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-48fe5cc8-2260-45d0-b201-0a18c49ca30d req-90bc0cb1-d727-439c-b968-53e2c5465850 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.756570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-48fe5cc8-2260-45d0-b201-0a18c49ca30d req-90bc0cb1-d727-439c-b968-53e2c5465850 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.778177 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-48fe5cc8-2260-45d0-b201-0a18c49ca30d req-90bc0cb1-d727-439c-b968-53e2c5465850 service nova] Creating event network-changed:38ff92c0-a00a-47e1-8c8a-767f34ecb3de for instance 33c564d4-6300-4c60-8829-01e8f445ce7a on hv-cinder-84841 Jul 25 06:02:56.786368 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-48fe5cc8-2260-45d0-b201-0a18c49ca30d req-90bc0cb1-d727-439c-b968-53e2c5465850 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045129 Jul 25 06:02:56.787584 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 276/558] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:02:56.795850 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:56.951727 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9353584d-474e-4d89-a6c1-c196d20f7f56 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 204 len: 0 microversion: 2.1 time: 0.319215 Jul 25 06:02:56.952703 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 283/559] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:02:56 2022] DELETE /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:02:56.961270 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-10ddd731-7100-4c8f-b037-77a2dd878d23 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:56.962044 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-10ddd731-7100-4c8f-b037-77a2dd878d23 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:56.970003 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-10ddd731-7100-4c8f-b037-77a2dd878d23 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.970447 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-10ddd731-7100-4c8f-b037-77a2dd878d23 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:56.971202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-10ddd731-7100-4c8f-b037-77a2dd878d23 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:56.971629 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-10ddd731-7100-4c8f-b037-77a2dd878d23 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:57.115329 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-10ddd731-7100-4c8f-b037-77a2dd878d23 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:57.123564 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-10ddd731-7100-4c8f-b037-77a2dd878d23 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1681 microversion: 2.1 time: 0.166552 Jul 25 06:02:57.124192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 277/560] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:56 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:57.361306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5467552e-6c74-4b9e-8dce-5eb44a6c4bc0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:57.362104 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5467552e-6c74-4b9e-8dce-5eb44a6c4bc0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:57.370928 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5467552e-6c74-4b9e-8dce-5eb44a6c4bc0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:57.371372 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5467552e-6c74-4b9e-8dce-5eb44a6c4bc0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:57.372351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5467552e-6c74-4b9e-8dce-5eb44a6c4bc0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:57.372783 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5467552e-6c74-4b9e-8dce-5eb44a6c4bc0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:57.605769 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5467552e-6c74-4b9e-8dce-5eb44a6c4bc0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:57.613432 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5467552e-6c74-4b9e-8dce-5eb44a6c4bc0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.256529 Jul 25 06:02:57.614145 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 284/561] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:57 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:57.651309 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0cf9780a-85e9-436a-9f7b-91e89d1ccf02 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:57.651598 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-0cf9780a-85e9-436a-9f7b-91e89d1ccf02 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:57.658012 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0cf9780a-85e9-436a-9f7b-91e89d1ccf02 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:57.658466 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0cf9780a-85e9-436a-9f7b-91e89d1ccf02 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:57.659234 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0cf9780a-85e9-436a-9f7b-91e89d1ccf02 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:57.659671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0cf9780a-85e9-436a-9f7b-91e89d1ccf02 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:57.693113 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4f85aca2-2444-4d35-af84-09668befbeb0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:57.702150 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4f85aca2-2444-4d35-af84-09668befbeb0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:57.709895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4f85aca2-2444-4d35-af84-09668befbeb0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:57.710632 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4f85aca2-2444-4d35-af84-09668befbeb0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:57.711407 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4f85aca2-2444-4d35-af84-09668befbeb0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:57.711845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4f85aca2-2444-4d35-af84-09668befbeb0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:57.808683 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-0cf9780a-85e9-436a-9f7b-91e89d1ccf02 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:57.819115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-0cf9780a-85e9-436a-9f7b-91e89d1ccf02 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:57.823626 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-0cf9780a-85e9-436a-9f7b-91e89d1ccf02 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:57.825144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0cf9780a-85e9-436a-9f7b-91e89d1ccf02 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.179016 Jul 25 06:02:57.825726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 278/562] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:57 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:57.972809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4f85aca2-2444-4d35-af84-09668befbeb0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:57.981487 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4f85aca2-2444-4d35-af84-09668befbeb0 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1502 microversion: 2.1 time: 0.295193 Jul 25 06:02:57.982134 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 285/563] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:57 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:58.142813 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2a5cb492-8038-484d-bd48-711cc751fabe tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:58.143441 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2a5cb492-8038-484d-bd48-711cc751fabe tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:58.161209 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2a5cb492-8038-484d-bd48-711cc751fabe tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:58.161979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2a5cb492-8038-484d-bd48-711cc751fabe tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:58.162992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2a5cb492-8038-484d-bd48-711cc751fabe tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:58.163436 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2a5cb492-8038-484d-bd48-711cc751fabe tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:58.345743 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2a5cb492-8038-484d-bd48-711cc751fabe tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:58.354639 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2a5cb492-8038-484d-bd48-711cc751fabe tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1681 microversion: 2.1 time: 0.217235 Jul 25 06:02:58.359240 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 279/564] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:58 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:58.631292 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f7d70d11-7fce-4ee2-9c7c-61764d0f5c50 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:58.631918 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f7d70d11-7fce-4ee2-9c7c-61764d0f5c50 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:58.649344 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f7d70d11-7fce-4ee2-9c7c-61764d0f5c50 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:58.650025 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f7d70d11-7fce-4ee2-9c7c-61764d0f5c50 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:58.651347 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f7d70d11-7fce-4ee2-9c7c-61764d0f5c50 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:58.654745 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f7d70d11-7fce-4ee2-9c7c-61764d0f5c50 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:58.792666 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f7d70d11-7fce-4ee2-9c7c-61764d0f5c50 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:58.800242 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f7d70d11-7fce-4ee2-9c7c-61764d0f5c50 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.173349 Jul 25 06:02:58.800812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 286/565] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:58 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:58.842939 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2ccd026e-2c7f-4934-aa33-feff5510a251 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:58.843544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2ccd026e-2c7f-4934-aa33-feff5510a251 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:58.845550 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:58.850632 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ccd026e-2c7f-4934-aa33-feff5510a251 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:58.851076 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ccd026e-2c7f-4934-aa33-feff5510a251 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:58.853528 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ccd026e-2c7f-4934-aa33-feff5510a251 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:58.853528 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ccd026e-2c7f-4934-aa33-feff5510a251 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:58.998659 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2ccd026e-2c7f-4934-aa33-feff5510a251 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:59.007578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a43553a5-5c4b-41e8-9a76-dfd36d9d297f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:59.009795 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2ccd026e-2c7f-4934-aa33-feff5510a251 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:59.010618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-a43553a5-5c4b-41e8-9a76-dfd36d9d297f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:59.011970 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2ccd026e-2c7f-4934-aa33-feff5510a251 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:59.019606 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2ccd026e-2c7f-4934-aa33-feff5510a251 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.180373 Jul 25 06:02:59.021176 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 280/566] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:02:58 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:02:59.023629 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a43553a5-5c4b-41e8-9a76-dfd36d9d297f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:59.024077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a43553a5-5c4b-41e8-9a76-dfd36d9d297f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:59.025522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a43553a5-5c4b-41e8-9a76-dfd36d9d297f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:59.026186 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a43553a5-5c4b-41e8-9a76-dfd36d9d297f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:59.162279 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a43553a5-5c4b-41e8-9a76-dfd36d9d297f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:59.170790 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a43553a5-5c4b-41e8-9a76-dfd36d9d297f tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1502 microversion: 2.1 time: 0.168960 Jul 25 06:02:59.171552 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 287/567] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:59 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:02:59.373830 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b8a6cd2a-72d4-4b95-b0b6-a04d3416eef7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:59.374452 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b8a6cd2a-72d4-4b95-b0b6-a04d3416eef7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:59.380905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b8a6cd2a-72d4-4b95-b0b6-a04d3416eef7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:59.382910 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b8a6cd2a-72d4-4b95-b0b6-a04d3416eef7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:59.382910 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b8a6cd2a-72d4-4b95-b0b6-a04d3416eef7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:59.382910 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b8a6cd2a-72d4-4b95-b0b6-a04d3416eef7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:59.541632 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b8a6cd2a-72d4-4b95-b0b6-a04d3416eef7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:02:59.550503 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b8a6cd2a-72d4-4b95-b0b6-a04d3416eef7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1681 microversion: 2.1 time: 0.180659 Jul 25 06:02:59.551168 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 281/568] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:59 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:02:59.818079 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1d183976-0bf1-441a-a59f-4315c33cc9f2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:02:59.818770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1d183976-0bf1-441a-a59f-4315c33cc9f2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:02:59.829504 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1d183976-0bf1-441a-a59f-4315c33cc9f2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:59.830214 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1d183976-0bf1-441a-a59f-4315c33cc9f2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:02:59.831253 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1d183976-0bf1-441a-a59f-4315c33cc9f2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:02:59.831681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1d183976-0bf1-441a-a59f-4315c33cc9f2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.041072 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-79658f4d-39d3-4663-a2b3-bae3512b6b8a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:00.041834 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-79658f4d-39d3-4663-a2b3-bae3512b6b8a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:00.049847 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-79658f4d-39d3-4663-a2b3-bae3512b6b8a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.050301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-79658f4d-39d3-4663-a2b3-bae3512b6b8a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.051547 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-79658f4d-39d3-4663-a2b3-bae3512b6b8a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.052238 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-79658f4d-39d3-4663-a2b3-bae3512b6b8a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.263851 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-79658f4d-39d3-4663-a2b3-bae3512b6b8a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:00.272948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-79658f4d-39d3-4663-a2b3-bae3512b6b8a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:00.274475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-79658f4d-39d3-4663-a2b3-bae3512b6b8a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:00.276218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-79658f4d-39d3-4663-a2b3-bae3512b6b8a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.240063 Jul 25 06:03:00.290319 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 282/569] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:00 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:00.296422 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-740dceaf-ac1e-434a-866e-3ecb7ba90806 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:00.297551 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-740dceaf-ac1e-434a-866e-3ecb7ba90806 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:00.305931 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-740dceaf-ac1e-434a-866e-3ecb7ba90806 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.306818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-740dceaf-ac1e-434a-866e-3ecb7ba90806 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.310039 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-740dceaf-ac1e-434a-866e-3ecb7ba90806 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.310681 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-740dceaf-ac1e-434a-866e-3ecb7ba90806 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.397482 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1d183976-0bf1-441a-a59f-4315c33cc9f2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:00.416252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1d183976-0bf1-441a-a59f-4315c33cc9f2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.599558 Jul 25 06:03:00.417505 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 288/570] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:02:59 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:00.578263 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-88bdc9e1-4d90-425a-8148-972351c70f32 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:00.579515 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-88bdc9e1-4d90-425a-8148-972351c70f32 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:00.587005 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88bdc9e1-4d90-425a-8148-972351c70f32 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.587592 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88bdc9e1-4d90-425a-8148-972351c70f32 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.591716 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88bdc9e1-4d90-425a-8148-972351c70f32 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:00.595637 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88bdc9e1-4d90-425a-8148-972351c70f32 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:00.973085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-740dceaf-ac1e-434a-866e-3ecb7ba90806 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:00.981520 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-740dceaf-ac1e-434a-866e-3ecb7ba90806 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1502 microversion: 2.1 time: 0.689301 Jul 25 06:03:00.985461 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 283/571] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:00 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1502 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:01.010311 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-6cee3fc8-0566-482d-87ee-cda1ae755c6b req-ef7144f7-b686-4420-9bdc-694b1fe0b526 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "65bf5eef-5bf1-458e-bed9-c7184fc1f2e2", "name": "network-vif-deleted", "tag": "f2d5059f-ba0a-49d2-b470-adede8bbdc2e"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:01.028761 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-6cee3fc8-0566-482d-87ee-cda1ae755c6b req-ef7144f7-b686-4420-9bdc-694b1fe0b526 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:01.029272 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-6cee3fc8-0566-482d-87ee-cda1ae755c6b req-ef7144f7-b686-4420-9bdc-694b1fe0b526 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:01.050920 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-6cee3fc8-0566-482d-87ee-cda1ae755c6b req-ef7144f7-b686-4420-9bdc-694b1fe0b526 service nova] Creating event network-vif-deleted:f2d5059f-ba0a-49d2-b470-adede8bbdc2e for instance 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 on hv-cinder-84841 Jul 25 06:03:01.064652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-6cee3fc8-0566-482d-87ee-cda1ae755c6b req-ef7144f7-b686-4420-9bdc-694b1fe0b526 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059484 Jul 25 06:03:01.065284 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 284/572] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:01.104682 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-88bdc9e1-4d90-425a-8148-972351c70f32 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:01.115747 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-88bdc9e1-4d90-425a-8148-972351c70f32 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1681 microversion: 2.1 time: 0.542873 Jul 25 06:03:01.116383 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 289/573] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:00 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1681 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:01.301778 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-dd281ea7-d78f-4f6e-a461-36a2138bdbce tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:01.302902 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-dd281ea7-d78f-4f6e-a461-36a2138bdbce tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:01.315978 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dd281ea7-d78f-4f6e-a461-36a2138bdbce tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:01.316469 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dd281ea7-d78f-4f6e-a461-36a2138bdbce tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:01.317279 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dd281ea7-d78f-4f6e-a461-36a2138bdbce tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:01.317719 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dd281ea7-d78f-4f6e-a461-36a2138bdbce tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:01.438523 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3368adf3-24b2-4953-995a-d8f49c74500e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:01.443337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3368adf3-24b2-4953-995a-d8f49c74500e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:01.466223 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3368adf3-24b2-4953-995a-d8f49c74500e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:01.469279 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3368adf3-24b2-4953-995a-d8f49c74500e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:01.470333 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3368adf3-24b2-4953-995a-d8f49c74500e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:01.472755 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3368adf3-24b2-4953-995a-d8f49c74500e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:01.931775 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3368adf3-24b2-4953-995a-d8f49c74500e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:01.949315 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-dd281ea7-d78f-4f6e-a461-36a2138bdbce tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:01.956106 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3368adf3-24b2-4953-995a-d8f49c74500e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.526990 Jul 25 06:03:01.957361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 290/574] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:01 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:01.960417 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-dd281ea7-d78f-4f6e-a461-36a2138bdbce tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:01.965871 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-dd281ea7-d78f-4f6e-a461-36a2138bdbce tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:01.967904 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-dd281ea7-d78f-4f6e-a461-36a2138bdbce tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.673291 Jul 25 06:03:01.969038 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 285/575] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:01 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:02.003083 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-48a2bee5-9cc3-41b5-aa32-ee7f998c2def tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:02.003889 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-48a2bee5-9cc3-41b5-aa32-ee7f998c2def tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:02.012608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48a2bee5-9cc3-41b5-aa32-ee7f998c2def tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:02.015428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48a2bee5-9cc3-41b5-aa32-ee7f998c2def tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:02.017916 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48a2bee5-9cc3-41b5-aa32-ee7f998c2def tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:02.018604 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48a2bee5-9cc3-41b5-aa32-ee7f998c2def tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:02.099022 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48a2bee5-9cc3-41b5-aa32-ee7f998c2def tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:02.101149 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48a2bee5-9cc3-41b5-aa32-ee7f998c2def tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:02.101745 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-48a2bee5-9cc3-41b5-aa32-ee7f998c2def tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lazy-loading 'fault' on Instance uuid 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:02.145951 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-51b47bea-75dc-4123-b8e8-78fb457fe3c7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:02.146501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-51b47bea-75dc-4123-b8e8-78fb457fe3c7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:02.159578 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-51b47bea-75dc-4123-b8e8-78fb457fe3c7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:02.161670 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-51b47bea-75dc-4123-b8e8-78fb457fe3c7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:02.162654 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-51b47bea-75dc-4123-b8e8-78fb457fe3c7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:02.169607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-51b47bea-75dc-4123-b8e8-78fb457fe3c7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:02.217272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-48a2bee5-9cc3-41b5-aa32-ee7f998c2def tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:02.230651 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-48a2bee5-9cc3-41b5-aa32-ee7f998c2def tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1303 microversion: 2.1 time: 0.231570 Jul 25 06:03:02.234663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 291/576] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:01 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:02.459683 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-51b47bea-75dc-4123-b8e8-78fb457fe3c7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:02.471092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-51b47bea-75dc-4123-b8e8-78fb457fe3c7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1614 microversion: 2.1 time: 0.341533 Jul 25 06:03:02.471683 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 286/577] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:02 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1614 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:02.646406 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-9024e192-79b6-4484-b80a-04b8c8f45d1d req-19ec0ce7-d86c-4e51-9ca7-6d69a1f329ab service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "cffe93da-af1c-417f-8b03-0d6262028356", "name": "network-vif-deleted", "tag": "1ed76246-6a82-44fa-b633-e34bc3bf0089"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:02.663353 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-9024e192-79b6-4484-b80a-04b8c8f45d1d req-19ec0ce7-d86c-4e51-9ca7-6d69a1f329ab service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:02.664132 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-9024e192-79b6-4484-b80a-04b8c8f45d1d req-19ec0ce7-d86c-4e51-9ca7-6d69a1f329ab service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:02.690655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-9024e192-79b6-4484-b80a-04b8c8f45d1d req-19ec0ce7-d86c-4e51-9ca7-6d69a1f329ab service nova] Creating event network-vif-deleted:1ed76246-6a82-44fa-b633-e34bc3bf0089 for instance cffe93da-af1c-417f-8b03-0d6262028356 on hv-cinder-84841 Jul 25 06:03:02.712058 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-9024e192-79b6-4484-b80a-04b8c8f45d1d req-19ec0ce7-d86c-4e51-9ca7-6d69a1f329ab service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069443 Jul 25 06:03:02.716060 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 292/578] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:02.978962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-19e36825-4012-48a4-992f-af7cdd16d503 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:02.979580 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-19e36825-4012-48a4-992f-af7cdd16d503 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:02.987565 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-45dc1208-7143-4d81-bcaf-ceb4d9d7e5c2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:02.988570 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-45dc1208-7143-4d81-bcaf-ceb4d9d7e5c2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:03.006466 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-19e36825-4012-48a4-992f-af7cdd16d503 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.008192 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-45dc1208-7143-4d81-bcaf-ceb4d9d7e5c2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.009072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-45dc1208-7143-4d81-bcaf-ceb4d9d7e5c2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.011316 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-19e36825-4012-48a4-992f-af7cdd16d503 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.013000 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-19e36825-4012-48a4-992f-af7cdd16d503 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.013403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-45dc1208-7143-4d81-bcaf-ceb4d9d7e5c2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.014016 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-19e36825-4012-48a4-992f-af7cdd16d503 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.015613 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-45dc1208-7143-4d81-bcaf-ceb4d9d7e5c2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.327238 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-19e36825-4012-48a4-992f-af7cdd16d503 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:03.337941 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-45dc1208-7143-4d81-bcaf-ceb4d9d7e5c2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:03.339016 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-19e36825-4012-48a4-992f-af7cdd16d503 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.369093 Jul 25 06:03:03.342512 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 287/579] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:02 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:03.354741 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-45dc1208-7143-4d81-bcaf-ceb4d9d7e5c2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:03.355212 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-906e5931-cd3a-43a9-b881-30fc756142f6 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:03.355960 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-906e5931-cd3a-43a9-b881-30fc756142f6 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:03.357164 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-45dc1208-7143-4d81-bcaf-ceb4d9d7e5c2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:03.359977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-45dc1208-7143-4d81-bcaf-ceb4d9d7e5c2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.377862 Jul 25 06:03:03.363642 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 293/580] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:02 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:03:03.368088 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-906e5931-cd3a-43a9-b881-30fc756142f6 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.371372 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-906e5931-cd3a-43a9-b881-30fc756142f6 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.372200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-906e5931-cd3a-43a9-b881-30fc756142f6 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.374770 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-906e5931-cd3a-43a9-b881-30fc756142f6 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.390060 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=100 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:03.450647 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-906e5931-cd3a-43a9-b881-30fc756142f6 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.451346 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-906e5931-cd3a-43a9-b881-30fc756142f6 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.451974 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-906e5931-cd3a-43a9-b881-30fc756142f6 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lazy-loading 'fault' on Instance uuid 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:03.491575 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ec012d8b-26fb-48fc-9546-5bd36ac6d3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:03.493116 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ec012d8b-26fb-48fc-9546-5bd36ac6d3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:03.516938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec012d8b-26fb-48fc-9546-5bd36ac6d3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.520312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec012d8b-26fb-48fc-9546-5bd36ac6d3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.520312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec012d8b-26fb-48fc-9546-5bd36ac6d3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:03.522665 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec012d8b-26fb-48fc-9546-5bd36ac6d3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:03.533646 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-906e5931-cd3a-43a9-b881-30fc756142f6 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f64211ceb949d398e47bc18e2abbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62f9df69f47d0ad40154526b95be1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:03.542980 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-906e5931-cd3a-43a9-b881-30fc756142f6 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 200 len: 1303 microversion: 2.1 time: 0.199339 Jul 25 06:03:03.544776 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 288/581] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:03 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 1303 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:03.725659 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ec012d8b-26fb-48fc-9546-5bd36ac6d3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:03.740295 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ec012d8b-26fb-48fc-9546-5bd36ac6d3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1327 microversion: 2.1 time: 0.255178 Jul 25 06:03:03.742368 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 294/582] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:03 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1327 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:04.358527 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-07a7a590-3c3a-4fe9-b343-a2d153d7f4b5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:04.358527 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-07a7a590-3c3a-4fe9-b343-a2d153d7f4b5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:04.367365 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-07a7a590-3c3a-4fe9-b343-a2d153d7f4b5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.367814 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-07a7a590-3c3a-4fe9-b343-a2d153d7f4b5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.368616 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-07a7a590-3c3a-4fe9-b343-a2d153d7f4b5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.375924 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-07a7a590-3c3a-4fe9-b343-a2d153d7f4b5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.388010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-59f1c052-5f87-4c3d-badc-4c518b4c551e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:04.388654 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-59f1c052-5f87-4c3d-badc-4c518b4c551e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:04.408191 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59f1c052-5f87-4c3d-badc-4c518b4c551e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.408651 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59f1c052-5f87-4c3d-badc-4c518b4c551e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.409432 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59f1c052-5f87-4c3d-badc-4c518b4c551e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.414218 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59f1c052-5f87-4c3d-badc-4c518b4c551e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.746958 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-59f1c052-5f87-4c3d-badc-4c518b4c551e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:04.761996 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-07a7a590-3c3a-4fe9-b343-a2d153d7f4b5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:04.782146 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-59f1c052-5f87-4c3d-badc-4c518b4c551e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:04.805429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-59f1c052-5f87-4c3d-badc-4c518b4c551e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:04.805429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-59f1c052-5f87-4c3d-badc-4c518b4c551e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.402289 Jul 25 06:03:04.805429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 295/583] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:04 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:04.806138 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-07a7a590-3c3a-4fe9-b343-a2d153d7f4b5 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.436572 Jul 25 06:03:04.806138 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 289/584] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:04 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:04.806138 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-00113653-4d6e-424e-a134-f575b2bd7235 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:04.807091 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-60bf51ef-0cb6-479c-a690-5521c4ed0183 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:04.807091 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-60bf51ef-0cb6-479c-a690-5521c4ed0183 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] [instance: 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:04.808659 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-00113653-4d6e-424e-a134-f575b2bd7235 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:04.818324 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-00113653-4d6e-424e-a134-f575b2bd7235 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.819009 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-00113653-4d6e-424e-a134-f575b2bd7235 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.819978 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-00113653-4d6e-424e-a134-f575b2bd7235 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.820603 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-00113653-4d6e-424e-a134-f575b2bd7235 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.827990 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60bf51ef-0cb6-479c-a690-5521c4ed0183 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.835826 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60bf51ef-0cb6-479c-a690-5521c4ed0183 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.837007 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60bf51ef-0cb6-479c-a690-5521c4ed0183 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.837562 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60bf51ef-0cb6-479c-a690-5521c4ed0183 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.880724 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-60bf51ef-0cb6-479c-a690-5521c4ed0183 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] HTTP exception thrown: Instance 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 could not be found. Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-60bf51ef-0cb6-479c-a690-5521c4ed0183 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Request method failure captured: Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 HTTP/1.1 Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jHKAlx8fEy_1jSW2Ry9VpGEvWKT-utTOOhj7vDsTOOmHUwwBoFp8paPo9X9HHCvvbo1nNahzt2vPUHbke9KT4RN8jmrILEczQ289KA28GLc57pxscyaKIHLBxsoWIEaxO5pzFFKbU0o_dIKjfE8hcPDbjdneJ_yo0O0un8-y4fWTDs Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: e3f62f9df69f47d0ad40154526b95be1 Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-VolumesActionsTest-1809851383 Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:03:04.882544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e3f62f9df69f47d0ad40154526b95be1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3f62f9df69f47d0ad40154526b95be1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e3f62f9df69f47d0ad40154526b95be1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e3f62f9df69f47d0ad40154526b95be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-VolumesActionsTest-1809851383 Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: e3f62f9df69f47d0ad40154526b95be1 Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-VolumesActionsTest-1809851383 Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-VolumesActionsTest-1809851383-project Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 66f64211ceb949d398e47bc18e2abbca Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-VolumesActionsTest-1809851383-project Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 could not be found. Jul 25 06:03:04.895859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': '65bf5eef-5bf1-458e-bed9-c7184fc1f2e2'} Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 could not be found. Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:03:04.896860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 could not be found. Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 could not be found. Jul 25 06:03:04.898351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:03:04.899655 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-00113653-4d6e-424e-a134-f575b2bd7235 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.899753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-60bf51ef-0cb6-479c-a690-5521c4ed0183 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] Returning 404 to user: Instance 65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:03:04.899854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-00113653-4d6e-424e-a134-f575b2bd7235 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.899854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-00113653-4d6e-424e-a134-f575b2bd7235 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lazy-loading 'fault' on Instance uuid cffe93da-af1c-417f-8b03-0d6262028356 {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:04.900087 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-60bf51ef-0cb6-479c-a690-5521c4ed0183 tempest-VolumesActionsTest-1809851383 tempest-VolumesActionsTest-1809851383-project] 10.222.0.40 "GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2" status: 404 len: 111 microversion: 2.1 time: 0.093558 Jul 25 06:03:04.900087 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 296/585] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:04 2022] GET /compute/v2.1/servers/65bf5eef-5bf1-458e-bed9-c7184fc1f2e2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:03:04.925671 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-cfc6dc63-1e1f-4a8a-98bb-6d591395cd1e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4880>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:04.926324 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cfc6dc63-1e1f-4a8a-98bb-6d591395cd1e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:04.944838 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cfc6dc63-1e1f-4a8a-98bb-6d591395cd1e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.945296 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cfc6dc63-1e1f-4a8a-98bb-6d591395cd1e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.946303 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cfc6dc63-1e1f-4a8a-98bb-6d591395cd1e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:04.954806 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cfc6dc63-1e1f-4a8a-98bb-6d591395cd1e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:04.986513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-00113653-4d6e-424e-a134-f575b2bd7235 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:04.999390 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-00113653-4d6e-424e-a134-f575b2bd7235 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 200 len: 1332 microversion: 2.1 time: 0.204046 Jul 25 06:03:05.000477 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 290/586] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:04 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 1332 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:05.005993 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-eaa145d8-62b8-40b4-8121-bfd40b59508e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Action: 'action', calling method: <bound method RescueController._rescue of <nova.api.openstack.compute.rescue.RescueController object at 0x7f6533ed8e50>>, body: {"rescue": {"adminPass": "***"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:05.007191 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-eaa145d8-62b8-40b4-8121-bfd40b59508e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:05.016075 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-eaa145d8-62b8-40b4-8121-bfd40b59508e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.016565 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-eaa145d8-62b8-40b4-8121-bfd40b59508e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.017428 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-eaa145d8-62b8-40b4-8121-bfd40b59508e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.017865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-eaa145d8-62b8-40b4-8121-bfd40b59508e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.054253 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-eaa145d8-62b8-40b4-8121-bfd40b59508e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lazy-loading 'flavor' on Instance uuid e750488b-116b-4f02-a4bd-710c3867fa27 {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:05.153255 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-cfc6dc63-1e1f-4a8a-98bb-6d591395cd1e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lazy-loading 'services' on Instance uuid a502c8d3-07ac-4e7f-9127-1281c94c5724 {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:05.605663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-cfc6dc63-1e1f-4a8a-98bb-6d591395cd1e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/os-volume_attachments/2c538353-f5e8-476e-bc88-5207277140f4" status: 202 len: 0 microversion: 2.1 time: 0.685010 Jul 25 06:03:05.606617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 297/587] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:03:04 2022] DELETE /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/os-volume_attachments/2c538353-f5e8-476e-bc88-5207277140f4 => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 06:03:05.608424 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-eaa145d8-62b8-40b4-8121-bfd40b59508e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "POST /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/action" status: 200 len: 32 microversion: 2.1 time: 0.602747 Jul 25 06:03:05.612332 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 291/588] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:03:05 2022] POST /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/action => generated 32 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:03:05.638445 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-be497fae-13d6-4b20-b417-11088ac6bb09 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:05.639190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-be497fae-13d6-4b20-b417-11088ac6bb09 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:05.648725 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-be497fae-13d6-4b20-b417-11088ac6bb09 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.649413 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-be497fae-13d6-4b20-b417-11088ac6bb09 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.650410 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-be497fae-13d6-4b20-b417-11088ac6bb09 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.650851 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-be497fae-13d6-4b20-b417-11088ac6bb09 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.805386 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-210bdb85-5766-4476-9c72-60cabadae5dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:05.806337 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-210bdb85-5766-4476-9c72-60cabadae5dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:05.833166 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-210bdb85-5766-4476-9c72-60cabadae5dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.839949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-210bdb85-5766-4476-9c72-60cabadae5dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.842766 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-210bdb85-5766-4476-9c72-60cabadae5dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.843332 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-210bdb85-5766-4476-9c72-60cabadae5dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.863970 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-be497fae-13d6-4b20-b417-11088ac6bb09 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:05.879288 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-be497fae-13d6-4b20-b417-11088ac6bb09 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.261095 Jul 25 06:03:05.888817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 298/589] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:05 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:05.895295 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-dbd0d3ac-60bf-4112-ab35-0f47d931ce6e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:05.896364 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-dbd0d3ac-60bf-4112-ab35-0f47d931ce6e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:05.914133 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dbd0d3ac-60bf-4112-ab35-0f47d931ce6e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.914133 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dbd0d3ac-60bf-4112-ab35-0f47d931ce6e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:05.925678 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dbd0d3ac-60bf-4112-ab35-0f47d931ce6e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:05.926237 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dbd0d3ac-60bf-4112-ab35-0f47d931ce6e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:06.200443 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-dbd0d3ac-60bf-4112-ab35-0f47d931ce6e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:06.212296 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-dbd0d3ac-60bf-4112-ab35-0f47d931ce6e tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.321818 Jul 25 06:03:06.214010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 299/590] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:05 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:06.219414 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-50496175-7e89-4469-8624-ffb8902cd589 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:06.220503 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-50496175-7e89-4469-8624-ffb8902cd589 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:06.230068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-50496175-7e89-4469-8624-ffb8902cd589 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:06.231001 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-50496175-7e89-4469-8624-ffb8902cd589 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:06.237693 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-50496175-7e89-4469-8624-ffb8902cd589 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:06.237693 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-50496175-7e89-4469-8624-ffb8902cd589 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:06.258369 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-50496175-7e89-4469-8624-ffb8902cd589 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-50496175-7e89-4469-8624-ffb8902cd589 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 HTTP/1.1 Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:03:06.261817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:03:06.263213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'cffe93da-af1c-417f-8b03-0d6262028356'} Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:03:06.263950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:03:06.268178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:03:06.269327 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-50496175-7e89-4469-8624-ffb8902cd589 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:03:06.271154 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-50496175-7e89-4469-8624-ffb8902cd589 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 404 len: 111 microversion: 2.1 time: 0.055857 Jul 25 06:03:06.275349 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 300/591] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:06 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:03:06.279970 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-8ed7a738-5758-42fa-8d1f-aa689e77d5c8 req-1cb2ca35-aaaf-408d-948d-e917fca41834 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "b2dc5c54-08fc-4392-a4b9-f1970578ffb7", "name": "network-vif-plugged", "status": "completed", "tag": "c86fe1cd-ba90-483f-8c21-3093b1ee753e"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:06.292289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-8ed7a738-5758-42fa-8d1f-aa689e77d5c8 req-1cb2ca35-aaaf-408d-948d-e917fca41834 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:06.295624 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-8ed7a738-5758-42fa-8d1f-aa689e77d5c8 req-1cb2ca35-aaaf-408d-948d-e917fca41834 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:06.298409 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:06.311649 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-8ed7a738-5758-42fa-8d1f-aa689e77d5c8 req-1cb2ca35-aaaf-408d-948d-e917fca41834 service nova] Creating event network-vif-plugged:c86fe1cd-ba90-483f-8c21-3093b1ee753e for instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 on hv-cinder-84841 Jul 25 06:03:06.319326 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-8ed7a738-5758-42fa-8d1f-aa689e77d5c8 req-1cb2ca35-aaaf-408d-948d-e917fca41834 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045873 Jul 25 06:03:06.320212 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 301/592] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:06.331662 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0e934c81-d99c-4103-b195-034cf2a23347 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531e1a790>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:06.352799 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-210bdb85-5766-4476-9c72-60cabadae5dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:06.377460 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-210bdb85-5766-4476-9c72-60cabadae5dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:06.392454 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-210bdb85-5766-4476-9c72-60cabadae5dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:06.394875 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-210bdb85-5766-4476-9c72-60cabadae5dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.594638 Jul 25 06:03:06.411047 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 292/593] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:05 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:03:06.440015 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0e934c81-d99c-4103-b195-034cf2a23347 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771989104" status: 202 len: 0 microversion: 2.1 time: 0.118349 Jul 25 06:03:06.441198 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 302/594] 10.222.0.40 () {58 vars in 1220 bytes} [Mon Jul 25 06:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771989104 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:03:06.897474 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0c8d2151-b2e3-41b3-8b09-69f4ce6ddc39 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:06.898680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-0c8d2151-b2e3-41b3-8b09-69f4ce6ddc39 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:06.916741 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0c8d2151-b2e3-41b3-8b09-69f4ce6ddc39 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:06.918181 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0c8d2151-b2e3-41b3-8b09-69f4ce6ddc39 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:06.919141 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0c8d2151-b2e3-41b3-8b09-69f4ce6ddc39 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:06.920686 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0c8d2151-b2e3-41b3-8b09-69f4ce6ddc39 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:07.235312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-75255e89-c073-4b72-8ec5-4c87ef7d89d3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:07.241661 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-75255e89-c073-4b72-8ec5-4c87ef7d89d3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:07.254484 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75255e89-c073-4b72-8ec5-4c87ef7d89d3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:07.255254 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75255e89-c073-4b72-8ec5-4c87ef7d89d3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:07.257015 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75255e89-c073-4b72-8ec5-4c87ef7d89d3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:07.257015 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75255e89-c073-4b72-8ec5-4c87ef7d89d3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:07.331119 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-0c8d2151-b2e3-41b3-8b09-69f4ce6ddc39 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:07.346617 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0c8d2151-b2e3-41b3-8b09-69f4ce6ddc39 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.453032 Jul 25 06:03:07.348058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 293/595] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:06 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:07.415031 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7af6a30d-4b50-49e3-ad45-c4782ccc8fa2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:07.416380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7af6a30d-4b50-49e3-ad45-c4782ccc8fa2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:07.427145 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7af6a30d-4b50-49e3-ad45-c4782ccc8fa2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:07.427971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7af6a30d-4b50-49e3-ad45-c4782ccc8fa2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:07.429131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7af6a30d-4b50-49e3-ad45-c4782ccc8fa2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:07.429775 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7af6a30d-4b50-49e3-ad45-c4782ccc8fa2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:07.513195 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-75255e89-c073-4b72-8ec5-4c87ef7d89d3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:07.538222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-75255e89-c073-4b72-8ec5-4c87ef7d89d3 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.312879 Jul 25 06:03:07.542785 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 303/596] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:07 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:07.591199 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7af6a30d-4b50-49e3-ad45-c4782ccc8fa2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:07.601678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7af6a30d-4b50-49e3-ad45-c4782ccc8fa2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:07.604154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7af6a30d-4b50-49e3-ad45-c4782ccc8fa2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:07.605669 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7af6a30d-4b50-49e3-ad45-c4782ccc8fa2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.194826 Jul 25 06:03:07.606238 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 294/597] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:07 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:07.680957 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3778a707-c844-4433-a0b1-9b01f5ac2b48 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4880>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:07.684082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3778a707-c844-4433-a0b1-9b01f5ac2b48 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:07.690357 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3778a707-c844-4433-a0b1-9b01f5ac2b48 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:07.690786 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3778a707-c844-4433-a0b1-9b01f5ac2b48 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:07.691551 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3778a707-c844-4433-a0b1-9b01f5ac2b48 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:07.691982 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3778a707-c844-4433-a0b1-9b01f5ac2b48 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:07.780422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-3778a707-c844-4433-a0b1-9b01f5ac2b48 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lazy-loading 'services' on Instance uuid efb335ec-f540-494a-a2c7-c8db2f467c02 {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:07.834927 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1b367dac-b828-4c36-8be4-92412f3f7c73 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Action: 'action', calling method: <bound method ServersController._stop_server of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f3c8b0>>, body: {"os-stop": {}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:07.844269 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1b367dac-b828-4c36-8be4-92412f3f7c73 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:07.844886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1b367dac-b828-4c36-8be4-92412f3f7c73 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:07.872750 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1b367dac-b828-4c36-8be4-92412f3f7c73 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Going to try to stop instance {{(pid=124918) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 06:03:08.049326 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3778a707-c844-4433-a0b1-9b01f5ac2b48 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments/e5b9fbc3-bd4e-4941-bb6f-b015f283d330" status: 202 len: 0 microversion: 2.1 time: 0.372075 Jul 25 06:03:08.050175 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 304/598] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:03:07 2022] DELETE /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments/e5b9fbc3-bd4e-4941-bb6f-b015f283d330 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:03:08.059612 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2221ff1b-d5b7-47b2-826d-3f2692219ebf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:08.061003 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2221ff1b-d5b7-47b2-826d-3f2692219ebf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:08.068205 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2221ff1b-d5b7-47b2-826d-3f2692219ebf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.068653 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2221ff1b-d5b7-47b2-826d-3f2692219ebf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.073609 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2221ff1b-d5b7-47b2-826d-3f2692219ebf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.073609 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2221ff1b-d5b7-47b2-826d-3f2692219ebf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.105339 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2221ff1b-d5b7-47b2-826d-3f2692219ebf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050792 Jul 25 06:03:08.106271 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 305/599] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:03:08 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:08.148321 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1b367dac-b828-4c36-8be4-92412f3f7c73 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "POST /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/action" status: 202 len: 0 microversion: 2.1 time: 0.317001 Jul 25 06:03:08.152517 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 295/600] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:03:07 2022] POST /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 06:03:08.157457 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4c5e9938-7a42-4e54-a066-a52ca3caa2be tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:08.158065 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4c5e9938-7a42-4e54-a066-a52ca3caa2be tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:08.164552 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4c5e9938-7a42-4e54-a066-a52ca3caa2be tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.164728 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4c5e9938-7a42-4e54-a066-a52ca3caa2be tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.165488 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4c5e9938-7a42-4e54-a066-a52ca3caa2be tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.165976 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4c5e9938-7a42-4e54-a066-a52ca3caa2be tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.316140 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4c5e9938-7a42-4e54-a066-a52ca3caa2be tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:08.325907 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4c5e9938-7a42-4e54-a066-a52ca3caa2be tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1678 microversion: 2.1 time: 0.172145 Jul 25 06:03:08.326834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 306/601] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:08 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:08.365877 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ebf3d42f-b3f4-4c12-ace7-64c7bbdc9e5d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:08.366744 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ebf3d42f-b3f4-4c12-ace7-64c7bbdc9e5d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:08.373828 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ebf3d42f-b3f4-4c12-ace7-64c7bbdc9e5d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.374273 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ebf3d42f-b3f4-4c12-ace7-64c7bbdc9e5d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.375036 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ebf3d42f-b3f4-4c12-ace7-64c7bbdc9e5d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.375471 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ebf3d42f-b3f4-4c12-ace7-64c7bbdc9e5d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.530458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ebf3d42f-b3f4-4c12-ace7-64c7bbdc9e5d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:08.539274 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ebf3d42f-b3f4-4c12-ace7-64c7bbdc9e5d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.177600 Jul 25 06:03:08.539866 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 296/602] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:08 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:08.560732 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c8b12364-0fe9-4323-912b-ebfd7872ed2c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:08.561354 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c8b12364-0fe9-4323-912b-ebfd7872ed2c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:08.568007 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c8b12364-0fe9-4323-912b-ebfd7872ed2c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.568501 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c8b12364-0fe9-4323-912b-ebfd7872ed2c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.569397 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c8b12364-0fe9-4323-912b-ebfd7872ed2c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.569916 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c8b12364-0fe9-4323-912b-ebfd7872ed2c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.623651 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5fc72f10-16d3-4e2b-b697-b69c34539f01 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:08.624784 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5fc72f10-16d3-4e2b-b697-b69c34539f01 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:08.636648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5fc72f10-16d3-4e2b-b697-b69c34539f01 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.637095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5fc72f10-16d3-4e2b-b697-b69c34539f01 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.637865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5fc72f10-16d3-4e2b-b697-b69c34539f01 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:08.638376 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5fc72f10-16d3-4e2b-b697-b69c34539f01 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:08.735757 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c8b12364-0fe9-4323-912b-ebfd7872ed2c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:08.744895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c8b12364-0fe9-4323-912b-ebfd7872ed2c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.189944 Jul 25 06:03:08.773620 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 307/603] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:08 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:08.797069 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5fc72f10-16d3-4e2b-b697-b69c34539f01 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:08.806079 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5fc72f10-16d3-4e2b-b697-b69c34539f01 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:08.808085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5fc72f10-16d3-4e2b-b697-b69c34539f01 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:08.809693 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5fc72f10-16d3-4e2b-b697-b69c34539f01 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.189885 Jul 25 06:03:08.810430 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 297/604] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:08 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:03:09.117482 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a244dc92-a764-4bbd-9e31-3e69c5d065f1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:09.118576 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-a244dc92-a764-4bbd-9e31-3e69c5d065f1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:09.125444 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a244dc92-a764-4bbd-9e31-3e69c5d065f1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.125993 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a244dc92-a764-4bbd-9e31-3e69c5d065f1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.126776 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a244dc92-a764-4bbd-9e31-3e69c5d065f1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.127211 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a244dc92-a764-4bbd-9e31-3e69c5d065f1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.161762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a244dc92-a764-4bbd-9e31-3e69c5d065f1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048470 Jul 25 06:03:09.162350 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 308/605] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:03:09 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:09.344252 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9c051d6f-8b1e-4be2-b245-16e8c6d84842 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:09.345029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9c051d6f-8b1e-4be2-b245-16e8c6d84842 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:09.356596 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9c051d6f-8b1e-4be2-b245-16e8c6d84842 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.357516 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9c051d6f-8b1e-4be2-b245-16e8c6d84842 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.358868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9c051d6f-8b1e-4be2-b245-16e8c6d84842 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.359569 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9c051d6f-8b1e-4be2-b245-16e8c6d84842 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.510906 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9c051d6f-8b1e-4be2-b245-16e8c6d84842 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:09.518844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9c051d6f-8b1e-4be2-b245-16e8c6d84842 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1678 microversion: 2.1 time: 0.179578 Jul 25 06:03:09.519420 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 298/606] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:09 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:09.557709 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-66392f8b-bd3c-4813-9ec8-d91f73870f2f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:09.558327 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-66392f8b-bd3c-4813-9ec8-d91f73870f2f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:09.565988 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-66392f8b-bd3c-4813-9ec8-d91f73870f2f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.566445 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-66392f8b-bd3c-4813-9ec8-d91f73870f2f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.567293 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-66392f8b-bd3c-4813-9ec8-d91f73870f2f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.567736 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-66392f8b-bd3c-4813-9ec8-d91f73870f2f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.699167 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-66392f8b-bd3c-4813-9ec8-d91f73870f2f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:09.707387 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-66392f8b-bd3c-4813-9ec8-d91f73870f2f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.154300 Jul 25 06:03:09.707966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 309/607] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:09 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:09.781548 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b4755398-2643-4fc2-a8b2-fd0c3d23c07d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:09.782159 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b4755398-2643-4fc2-a8b2-fd0c3d23c07d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:09.788405 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b4755398-2643-4fc2-a8b2-fd0c3d23c07d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.789000 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b4755398-2643-4fc2-a8b2-fd0c3d23c07d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.789761 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b4755398-2643-4fc2-a8b2-fd0c3d23c07d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.790198 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b4755398-2643-4fc2-a8b2-fd0c3d23c07d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.829985 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8fbb607d-e1d8-44d2-9f5e-ea5436c93bdc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:09.829985 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8fbb607d-e1d8-44d2-9f5e-ea5436c93bdc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:09.836677 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbb607d-e1d8-44d2-9f5e-ea5436c93bdc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.837116 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbb607d-e1d8-44d2-9f5e-ea5436c93bdc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.838985 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbb607d-e1d8-44d2-9f5e-ea5436c93bdc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:09.839562 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbb607d-e1d8-44d2-9f5e-ea5436c93bdc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:09.938523 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b4755398-2643-4fc2-a8b2-fd0c3d23c07d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:09.950498 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b4755398-2643-4fc2-a8b2-fd0c3d23c07d tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.177457 Jul 25 06:03:09.951298 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 299/608] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:09 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:09.988345 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8fbb607d-e1d8-44d2-9f5e-ea5436c93bdc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:09.997974 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8fbb607d-e1d8-44d2-9f5e-ea5436c93bdc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:09.999620 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8fbb607d-e1d8-44d2-9f5e-ea5436c93bdc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:10.000806 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8fbb607d-e1d8-44d2-9f5e-ea5436c93bdc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.176076 Jul 25 06:03:10.001680 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 310/609] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:09 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:03:10.173395 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9eb6b922-33f0-4651-bcd5-c9e3bc4218c9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:10.174867 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9eb6b922-33f0-4651-bcd5-c9e3bc4218c9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:10.181905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9eb6b922-33f0-4651-bcd5-c9e3bc4218c9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.182531 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9eb6b922-33f0-4651-bcd5-c9e3bc4218c9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.183381 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9eb6b922-33f0-4651-bcd5-c9e3bc4218c9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.183906 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9eb6b922-33f0-4651-bcd5-c9e3bc4218c9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.218818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9eb6b922-33f0-4651-bcd5-c9e3bc4218c9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050162 Jul 25 06:03:10.219515 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 300/610] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:03:10 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:10.542897 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7ab29462-8c76-4257-9779-fb83c19bc437 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:10.542897 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7ab29462-8c76-4257-9779-fb83c19bc437 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:10.560468 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ab29462-8c76-4257-9779-fb83c19bc437 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.562254 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ab29462-8c76-4257-9779-fb83c19bc437 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.563062 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ab29462-8c76-4257-9779-fb83c19bc437 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.563507 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7ab29462-8c76-4257-9779-fb83c19bc437 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.729562 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7ab29462-8c76-4257-9779-fb83c19bc437 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:10.736085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-bfa5ee1b-8fa7-48ef-8918-3ceb6c50080d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:10.737701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-bfa5ee1b-8fa7-48ef-8918-3ceb6c50080d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:10.751489 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7ab29462-8c76-4257-9779-fb83c19bc437 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1678 microversion: 2.1 time: 0.216852 Jul 25 06:03:10.765655 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bfa5ee1b-8fa7-48ef-8918-3ceb6c50080d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.770576 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 311/611] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:10 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:10.770730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bfa5ee1b-8fa7-48ef-8918-3ceb6c50080d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.770730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bfa5ee1b-8fa7-48ef-8918-3ceb6c50080d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.770730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bfa5ee1b-8fa7-48ef-8918-3ceb6c50080d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.793890 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:10.859049 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-cac51fd0-1b69-4ce5-8b78-8344e5a7767c req-c97c0f91-c0e6-4294-addf-187509b31be6 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "33c564d4-6300-4c60-8829-01e8f445ce7a", "name": "network-vif-plugged", "status": "completed", "tag": "38ff92c0-a00a-47e1-8c8a-767f34ecb3de"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:10.873103 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-cac51fd0-1b69-4ce5-8b78-8344e5a7767c req-c97c0f91-c0e6-4294-addf-187509b31be6 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.878199 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-cac51fd0-1b69-4ce5-8b78-8344e5a7767c req-c97c0f91-c0e6-4294-addf-187509b31be6 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.895532 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-cac51fd0-1b69-4ce5-8b78-8344e5a7767c req-c97c0f91-c0e6-4294-addf-187509b31be6 service nova] Creating event network-vif-plugged:38ff92c0-a00a-47e1-8c8a-767f34ecb3de for instance 33c564d4-6300-4c60-8829-01e8f445ce7a on hv-cinder-84841 Jul 25 06:03:10.900381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-cac51fd0-1b69-4ce5-8b78-8344e5a7767c req-c97c0f91-c0e6-4294-addf-187509b31be6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044835 Jul 25 06:03:10.904779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 312/612] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:10.929947 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-bfa5ee1b-8fa7-48ef-8918-3ceb6c50080d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:10.938851 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-bfa5ee1b-8fa7-48ef-8918-3ceb6c50080d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.213157 Jul 25 06:03:10.939427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 301/613] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:10 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:10.975267 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3f1ef8b1-8f69-4bb4-88c4-fce093171838 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:10.976341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3f1ef8b1-8f69-4bb4-88c4-fce093171838 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:10.983306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3f1ef8b1-8f69-4bb4-88c4-fce093171838 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.984761 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3f1ef8b1-8f69-4bb4-88c4-fce093171838 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:10.984915 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3f1ef8b1-8f69-4bb4-88c4-fce093171838 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:10.985512 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3f1ef8b1-8f69-4bb4-88c4-fce093171838 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.020975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a9e89d77-f3c8-4c3a-bb40-73eb981dfd8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:11.024893 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a9e89d77-f3c8-4c3a-bb40-73eb981dfd8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:11.038990 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a9e89d77-f3c8-4c3a-bb40-73eb981dfd8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.045796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a9e89d77-f3c8-4c3a-bb40-73eb981dfd8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.047421 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a9e89d77-f3c8-4c3a-bb40-73eb981dfd8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.049737 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a9e89d77-f3c8-4c3a-bb40-73eb981dfd8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.181642 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3f1ef8b1-8f69-4bb4-88c4-fce093171838 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:11.197622 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3f1ef8b1-8f69-4bb4-88c4-fce093171838 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.233812 Jul 25 06:03:11.207051 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 313/614] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:10 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:11.231712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6aedde79-4332-41f2-8383-d22a1a8655b4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:11.232679 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6aedde79-4332-41f2-8383-d22a1a8655b4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:11.242560 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a9e89d77-f3c8-4c3a-bb40-73eb981dfd8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:11.245176 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6aedde79-4332-41f2-8383-d22a1a8655b4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.245697 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6aedde79-4332-41f2-8383-d22a1a8655b4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.246534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6aedde79-4332-41f2-8383-d22a1a8655b4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.247040 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6aedde79-4332-41f2-8383-d22a1a8655b4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.252384 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a9e89d77-f3c8-4c3a-bb40-73eb981dfd8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:11.262202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a9e89d77-f3c8-4c3a-bb40-73eb981dfd8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:11.264706 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a9e89d77-f3c8-4c3a-bb40-73eb981dfd8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.249469 Jul 25 06:03:11.278108 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 302/615] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:11 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:03:11.311736 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6aedde79-4332-41f2-8383-d22a1a8655b4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084984 Jul 25 06:03:11.313013 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 314/616] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:03:11 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:11.775803 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a2e0882a-de5a-473d-b7ef-e8203e4231c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:11.780980 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a2e0882a-de5a-473d-b7ef-e8203e4231c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:11.789157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a2e0882a-de5a-473d-b7ef-e8203e4231c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.789897 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a2e0882a-de5a-473d-b7ef-e8203e4231c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.791651 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a2e0882a-de5a-473d-b7ef-e8203e4231c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.792477 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a2e0882a-de5a-473d-b7ef-e8203e4231c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.956306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e7c72051-a961-4d54-8d8f-ad78556a44d2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:11.957522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e7c72051-a961-4d54-8d8f-ad78556a44d2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:11.969083 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7c72051-a961-4d54-8d8f-ad78556a44d2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.969788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7c72051-a961-4d54-8d8f-ad78556a44d2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:11.973765 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7c72051-a961-4d54-8d8f-ad78556a44d2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:11.974422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e7c72051-a961-4d54-8d8f-ad78556a44d2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:12.001423 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a2e0882a-de5a-473d-b7ef-e8203e4231c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:12.016735 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a2e0882a-de5a-473d-b7ef-e8203e4231c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1678 microversion: 2.1 time: 0.243733 Jul 25 06:03:12.017925 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 303/617] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:11 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:12.264289 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-078cc561-5bfe-43f8-bb0b-e6830d188fff tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:12.265481 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-078cc561-5bfe-43f8-bb0b-e6830d188fff tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:12.284988 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-078cc561-5bfe-43f8-bb0b-e6830d188fff tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:12.288329 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-078cc561-5bfe-43f8-bb0b-e6830d188fff tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:12.289495 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-078cc561-5bfe-43f8-bb0b-e6830d188fff tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:12.290192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-078cc561-5bfe-43f8-bb0b-e6830d188fff tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:12.344981 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e7c72051-a961-4d54-8d8f-ad78556a44d2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:12.359419 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e7c72051-a961-4d54-8d8f-ad78556a44d2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.407254 Jul 25 06:03:12.368068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 315/618] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:11 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:12.397412 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e4ae80d2-cea1-4bec-9a6b-67311d73c27f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:12.398312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e4ae80d2-cea1-4bec-9a6b-67311d73c27f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:12.417340 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e4ae80d2-cea1-4bec-9a6b-67311d73c27f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:12.426943 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e4ae80d2-cea1-4bec-9a6b-67311d73c27f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:12.426943 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e4ae80d2-cea1-4bec-9a6b-67311d73c27f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:12.426943 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e4ae80d2-cea1-4bec-9a6b-67311d73c27f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:12.566057 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-078cc561-5bfe-43f8-bb0b-e6830d188fff tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:12.575624 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-078cc561-5bfe-43f8-bb0b-e6830d188fff tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.317547 Jul 25 06:03:12.584756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 304/619] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:12 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:12.584756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-281a6363-d3fa-425a-9f7e-769f2fd9e6d2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:12.584756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-281a6363-d3fa-425a-9f7e-769f2fd9e6d2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:12.605706 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-281a6363-d3fa-425a-9f7e-769f2fd9e6d2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:12.608695 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-281a6363-d3fa-425a-9f7e-769f2fd9e6d2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:12.608695 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-281a6363-d3fa-425a-9f7e-769f2fd9e6d2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:12.608695 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-281a6363-d3fa-425a-9f7e-769f2fd9e6d2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:12.679101 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-281a6363-d3fa-425a-9f7e-769f2fd9e6d2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100904 Jul 25 06:03:12.679557 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 305/620] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:03:12 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:12.732264 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e4ae80d2-cea1-4bec-9a6b-67311d73c27f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:12.742776 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e4ae80d2-cea1-4bec-9a6b-67311d73c27f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:12.745089 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e4ae80d2-cea1-4bec-9a6b-67311d73c27f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:12.746266 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e4ae80d2-cea1-4bec-9a6b-67311d73c27f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.371436 Jul 25 06:03:12.747026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 316/621] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:12 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:13.035073 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-36991055-df8d-4964-928b-8156b14b8c10 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:13.035653 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-36991055-df8d-4964-928b-8156b14b8c10 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:13.046722 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-36991055-df8d-4964-928b-8156b14b8c10 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.048334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-36991055-df8d-4964-928b-8156b14b8c10 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.050150 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-36991055-df8d-4964-928b-8156b14b8c10 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.050608 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-36991055-df8d-4964-928b-8156b14b8c10 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.214899 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-36991055-df8d-4964-928b-8156b14b8c10 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:13.226293 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-36991055-df8d-4964-928b-8156b14b8c10 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1678 microversion: 2.1 time: 0.194834 Jul 25 06:03:13.227106 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 306/622] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:13 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:13.381255 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-34a41ec5-05d2-414d-9c93-a568228f9d6e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:13.381831 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-34a41ec5-05d2-414d-9c93-a568228f9d6e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:13.389023 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34a41ec5-05d2-414d-9c93-a568228f9d6e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.389470 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34a41ec5-05d2-414d-9c93-a568228f9d6e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.390605 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34a41ec5-05d2-414d-9c93-a568228f9d6e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.390733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-34a41ec5-05d2-414d-9c93-a568228f9d6e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.593027 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7c3ee833-a1d9-4bac-9e1a-a1534da6054a tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:13.594248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7c3ee833-a1d9-4bac-9e1a-a1534da6054a tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:13.606230 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7c3ee833-a1d9-4bac-9e1a-a1534da6054a tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.608685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7c3ee833-a1d9-4bac-9e1a-a1534da6054a tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.608685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7c3ee833-a1d9-4bac-9e1a-a1534da6054a tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.608685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7c3ee833-a1d9-4bac-9e1a-a1534da6054a tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.625468 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-34a41ec5-05d2-414d-9c93-a568228f9d6e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:13.639435 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-34a41ec5-05d2-414d-9c93-a568228f9d6e tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.262127 Jul 25 06:03:13.651913 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 317/623] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:13 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:13.691710 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2a9dd1ef-175a-47ca-a850-3d92cf48932d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:13.693053 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2a9dd1ef-175a-47ca-a850-3d92cf48932d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:13.704911 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2a9dd1ef-175a-47ca-a850-3d92cf48932d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.706290 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2a9dd1ef-175a-47ca-a850-3d92cf48932d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.708783 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2a9dd1ef-175a-47ca-a850-3d92cf48932d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.710847 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2a9dd1ef-175a-47ca-a850-3d92cf48932d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.793816 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2a9dd1ef-175a-47ca-a850-3d92cf48932d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106298 Jul 25 06:03:13.794619 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 318/624] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:03:13 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:03:13.803162 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7c3ee833-a1d9-4bac-9e1a-a1534da6054a tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:13.804206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a4cbd0c5-1964-4185-a814-c479d1f7b93d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:13.804767 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-a4cbd0c5-1964-4185-a814-c479d1f7b93d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:13.812308 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7c3ee833-a1d9-4bac-9e1a-a1534da6054a tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1318 microversion: 2.1 time: 0.223224 Jul 25 06:03:13.813064 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 307/625] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:13 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:13.825918 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a4cbd0c5-1964-4185-a814-c479d1f7b93d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.830157 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a4cbd0c5-1964-4185-a814-c479d1f7b93d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.835927 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a4cbd0c5-1964-4185-a814-c479d1f7b93d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.836948 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a4cbd0c5-1964-4185-a814-c479d1f7b93d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.873888 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-95abe3ad-7a86-4e48-a7f8-c28b1463b110 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:13.874377 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-95abe3ad-7a86-4e48-a7f8-c28b1463b110 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:13.882968 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:13.888054 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95abe3ad-7a86-4e48-a7f8-c28b1463b110 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.888600 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95abe3ad-7a86-4e48-a7f8-c28b1463b110 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.893408 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95abe3ad-7a86-4e48-a7f8-c28b1463b110 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:13.893408 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95abe3ad-7a86-4e48-a7f8-c28b1463b110 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:13.929664 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-95abe3ad-7a86-4e48-a7f8-c28b1463b110 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:03:14.065904 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a4cbd0c5-1964-4185-a814-c479d1f7b93d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:14.075149 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a4cbd0c5-1964-4185-a814-c479d1f7b93d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:14.076689 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a4cbd0c5-1964-4185-a814-c479d1f7b93d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:14.077919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a4cbd0c5-1964-4185-a814-c479d1f7b93d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1806 microversion: 2.20 time: 0.277570 Jul 25 06:03:14.088794 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 319/626] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:13 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1806 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:14.243652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8223c955-c34b-44b3-80d6-748183254150 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:14.252442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8223c955-c34b-44b3-80d6-748183254150 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:14.252442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8223c955-c34b-44b3-80d6-748183254150 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.252442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8223c955-c34b-44b3-80d6-748183254150 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.253447 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8223c955-c34b-44b3-80d6-748183254150 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.253926 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8223c955-c34b-44b3-80d6-748183254150 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.421872 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8223c955-c34b-44b3-80d6-748183254150 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:14.430308 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8223c955-c34b-44b3-80d6-748183254150 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1678 microversion: 2.1 time: 0.191003 Jul 25 06:03:14.432637 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 320/627] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:14 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:14.470386 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-95abe3ad-7a86-4e48-a7f8-c28b1463b110 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 204 len: 0 microversion: 2.1 time: 0.600298 Jul 25 06:03:14.471331 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 308/628] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:03:13 2022] DELETE /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 06:03:14.480451 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-524aa69d-4b80-43e5-9c85-01d1a97e9f3f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:14.481122 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-524aa69d-4b80-43e5-9c85-01d1a97e9f3f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:14.487966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-524aa69d-4b80-43e5-9c85-01d1a97e9f3f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.492856 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-524aa69d-4b80-43e5-9c85-01d1a97e9f3f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.495211 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-524aa69d-4b80-43e5-9c85-01d1a97e9f3f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.496037 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-524aa69d-4b80-43e5-9c85-01d1a97e9f3f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.641662 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-50341426-e16e-495c-a1dd-6318987d3a6d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6531ce0040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-687808174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESt7qSgr1ZP2AH4CL/nUbHA82O0Ow/AFZ9iMwSPRS5p/nyuFEMk1K2fqu4cxYIk54N7d08A5D3T3tyOFyn0x+gHSmXzmH35TjzmBGJYdvHMwTou/uYjHNGzKIJQtcyulQ=="}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:14.656943 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-524aa69d-4b80-43e5-9c85-01d1a97e9f3f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:14.664905 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-524aa69d-4b80-43e5-9c85-01d1a97e9f3f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1680 microversion: 2.1 time: 0.188525 Jul 25 06:03:14.666139 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 321/629] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:14 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:14.671326 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c4780cd8-9421-4085-91ee-ab9b63ddc0dc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:14.672874 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c4780cd8-9421-4085-91ee-ab9b63ddc0dc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:14.675107 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-50341426-e16e-495c-a1dd-6318987d3a6d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Getting quotas for project a18a468edefd401c835e7e368ac740e5. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:03:14.678843 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:14.680789 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c4780cd8-9421-4085-91ee-ab9b63ddc0dc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.681984 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c4780cd8-9421-4085-91ee-ab9b63ddc0dc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.682669 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-50341426-e16e-495c-a1dd-6318987d3a6d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Getting quotas for user e13b80595f1d4c8cb4522657c9a88cd6 and project a18a468edefd401c835e7e368ac740e5. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:03:14.683122 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c4780cd8-9421-4085-91ee-ab9b63ddc0dc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.683784 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c4780cd8-9421-4085-91ee-ab9b63ddc0dc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.796132 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-50341426-e16e-495c-a1dd-6318987d3a6d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.161411 Jul 25 06:03:14.797249 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 309/630] 10.222.0.40 () {60 vars in 1158 bytes} [Mon Jul 25 06:03:14 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:14.830409 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-cd6bdf0a-325c-40b8-acaf-183f741e4f6c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:14.832287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-cd6bdf0a-325c-40b8-acaf-183f741e4f6c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:14.844925 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cd6bdf0a-325c-40b8-acaf-183f741e4f6c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.845373 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cd6bdf0a-325c-40b8-acaf-183f741e4f6c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.846357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cd6bdf0a-325c-40b8-acaf-183f741e4f6c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:14.846942 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cd6bdf0a-325c-40b8-acaf-183f741e4f6c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:14.880612 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c4780cd8-9421-4085-91ee-ab9b63ddc0dc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:14.890494 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c4780cd8-9421-4085-91ee-ab9b63ddc0dc tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.222888 Jul 25 06:03:14.891232 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 322/631] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:14 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:14.907017 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1577003277", "imageRef": "458d3abe-25c0-4ef1-9886-6cb693dab0c9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-687808174", "networks": [{"uuid": "d44552f4-d09f-406e-b8fb-423b2c54a3ee"}]}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:15.005686 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cd6bdf0a-325c-40b8-acaf-183f741e4f6c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:15.017277 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-cd6bdf0a-325c-40b8-acaf-183f741e4f6c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1507 microversion: 2.1 time: 0.191086 Jul 25 06:03:15.017872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 310/632] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:14 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:15.035956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d5e9b1f4-f65e-45fe-915f-1f1804587c1c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f190>>, body: {"volumeAttachment": {"volumeId": "c1eaf0d6-328a-4f63-ba26-fe3defd35e94", "device": "/dev/sdb"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:15.037630 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d5e9b1f4-f65e-45fe-915f-1f1804587c1c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:15.044896 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d5e9b1f4-f65e-45fe-915f-1f1804587c1c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:15.045340 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d5e9b1f4-f65e-45fe-915f-1f1804587c1c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:15.046118 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d5e9b1f4-f65e-45fe-915f-1f1804587c1c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:15.046562 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d5e9b1f4-f65e-45fe-915f-1f1804587c1c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:16.357329 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] validate_networks() for [('d44552f4-d09f-406e-b8fb-423b2c54a3ee', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:03:17.191017 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d5e9b1f4-f65e-45fe-915f-1f1804587c1c tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "POST /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.159193 Jul 25 06:03:17.192437 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 311/633] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:03:15 2022] POST /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a/os-volume_attachments => generated 194 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:17.198581 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a6e61d99-da52-4747-b0d6-512aeeed8afa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:17.208299 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a6e61d99-da52-4747-b0d6-512aeeed8afa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:17.218637 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a6e61d99-da52-4747-b0d6-512aeeed8afa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.219403 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a6e61d99-da52-4747-b0d6-512aeeed8afa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.220439 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a6e61d99-da52-4747-b0d6-512aeeed8afa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.221060 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a6e61d99-da52-4747-b0d6-512aeeed8afa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.372652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a6e61d99-da52-4747-b0d6-512aeeed8afa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:17.384014 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a6e61d99-da52-4747-b0d6-512aeeed8afa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:17.386763 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a6e61d99-da52-4747-b0d6-512aeeed8afa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:17.388294 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a6e61d99-da52-4747-b0d6-512aeeed8afa tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1793 microversion: 2.20 time: 0.194309 Jul 25 06:03:17.403822 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 312/634] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:03:17 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1793 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:03:17.409528 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d0eec44b-08d8-422f-9028-881d55aa26d1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:17.412425 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d0eec44b-08d8-422f-9028-881d55aa26d1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:17.420358 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d0eec44b-08d8-422f-9028-881d55aa26d1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.421069 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d0eec44b-08d8-422f-9028-881d55aa26d1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.423462 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d0eec44b-08d8-422f-9028-881d55aa26d1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.424078 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d0eec44b-08d8-422f-9028-881d55aa26d1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.536643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:03:17.537408 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:03:17.538017 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:03:17.538530 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:03:17.539063 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:03:17.552481 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.553322 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.554904 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.555590 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.578417 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Getting quotas for project a18a468edefd401c835e7e368ac740e5. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:03:17.583781 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Getting quotas for user e13b80595f1d4c8cb4522657c9a88cd6 and project a18a468edefd401c835e7e368ac740e5. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:03:17.597991 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:03:17.601540 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='458d3abe-25c0-4ef1-9886-6cb693dab0c9',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:03:17.602722 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d0eec44b-08d8-422f-9028-881d55aa26d1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:17.610683 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d0eec44b-08d8-422f-9028-881d55aa26d1 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1678 microversion: 2.1 time: 0.205440 Jul 25 06:03:17.622051 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 313/635] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:17 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:17.622051 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-116d5a88-d2d4-4b31-aac3-b3b78b8f29e7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:17.622051 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-116d5a88-d2d4-4b31-aac3-b3b78b8f29e7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:17.626505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-116d5a88-d2d4-4b31-aac3-b3b78b8f29e7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.627128 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-116d5a88-d2d4-4b31-aac3-b3b78b8f29e7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.627735 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-116d5a88-d2d4-4b31-aac3-b3b78b8f29e7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.628189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-116d5a88-d2d4-4b31-aac3-b3b78b8f29e7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.762178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-dbece04b-c4ba-45bd-a81f-39d69815758d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.862250 Jul 25 06:03:17.762985 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 323/636] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:03:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:03:17.782830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b9e72ef5-134e-4940-9f90-560c48d8778d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:17.783444 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b9e72ef5-134e-4940-9f90-560c48d8778d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:17.796577 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9e72ef5-134e-4940-9f90-560c48d8778d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.797031 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9e72ef5-134e-4940-9f90-560c48d8778d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.797841 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9e72ef5-134e-4940-9f90-560c48d8778d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:17.798277 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9e72ef5-134e-4940-9f90-560c48d8778d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:17.860720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-116d5a88-d2d4-4b31-aac3-b3b78b8f29e7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:17.870940 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-116d5a88-d2d4-4b31-aac3-b3b78b8f29e7 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1680 microversion: 2.1 time: 0.257120 Jul 25 06:03:17.871531 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 314/637] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:17 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1680 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:17.887149 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-461bc9de-e127-4183-8b68-e3c0881f1cb0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:17.888977 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-461bc9de-e127-4183-8b68-e3c0881f1cb0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:17.973414 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-461bc9de-e127-4183-8b68-e3c0881f1cb0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:17.981796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-461bc9de-e127-4183-8b68-e3c0881f1cb0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1258 microversion: 2.1 time: 0.105050 Jul 25 06:03:17.987878 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 315/638] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:17 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1258 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:18.090725 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b9e72ef5-134e-4940-9f90-560c48d8778d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:18.104594 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b9e72ef5-134e-4940-9f90-560c48d8778d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.329039 Jul 25 06:03:18.108454 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 324/639] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:17 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:18.463152 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-95439c25-4f75-42d3-bb99-e0047854e8ac req-f82c47cc-efc1-43d9-ba01-93bc49ffcc86 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "efb335ec-f540-494a-a2c7-c8db2f467c02", "name": "network-vif-deleted", "tag": "d39effe6-1cf3-4165-9474-bb2a0cbbe15d"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:18.489104 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-95439c25-4f75-42d3-bb99-e0047854e8ac req-f82c47cc-efc1-43d9-ba01-93bc49ffcc86 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.489104 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-95439c25-4f75-42d3-bb99-e0047854e8ac req-f82c47cc-efc1-43d9-ba01-93bc49ffcc86 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.500571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-95439c25-4f75-42d3-bb99-e0047854e8ac req-f82c47cc-efc1-43d9-ba01-93bc49ffcc86 service nova] Creating event network-vif-deleted:d39effe6-1cf3-4165-9474-bb2a0cbbe15d for instance efb335ec-f540-494a-a2c7-c8db2f467c02 on hv-cinder-84841 Jul 25 06:03:18.513831 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-95439c25-4f75-42d3-bb99-e0047854e8ac req-f82c47cc-efc1-43d9-ba01-93bc49ffcc86 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072016 Jul 25 06:03:18.515094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 316/640] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:18.640441 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9b706bdc-97aa-4aaa-b551-f7361bf1bd0f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:18.640441 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9b706bdc-97aa-4aaa-b551-f7361bf1bd0f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:18.647671 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9b706bdc-97aa-4aaa-b551-f7361bf1bd0f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.648327 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9b706bdc-97aa-4aaa-b551-f7361bf1bd0f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.649162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9b706bdc-97aa-4aaa-b551-f7361bf1bd0f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.649851 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9b706bdc-97aa-4aaa-b551-f7361bf1bd0f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.798455 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9b706bdc-97aa-4aaa-b551-f7361bf1bd0f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:18.806144 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9b706bdc-97aa-4aaa-b551-f7361bf1bd0f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1678 microversion: 2.1 time: 0.170876 Jul 25 06:03:18.806950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 325/641] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:18 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:18.892504 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5c8a5d3d-5506-463f-9752-348cf1db4d1f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:18.893846 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5c8a5d3d-5506-463f-9752-348cf1db4d1f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:18.907701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5c8a5d3d-5506-463f-9752-348cf1db4d1f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.910993 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5c8a5d3d-5506-463f-9752-348cf1db4d1f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.910993 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5c8a5d3d-5506-463f-9752-348cf1db4d1f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.910993 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5c8a5d3d-5506-463f-9752-348cf1db4d1f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.934846 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:18.990634 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5c8a5d3d-5506-463f-9752-348cf1db4d1f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:18.995817 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5c8a5d3d-5506-463f-9752-348cf1db4d1f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:18.997663 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-5c8a5d3d-5506-463f-9752-348cf1db4d1f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lazy-loading 'fault' on Instance uuid efb335ec-f540-494a-a2c7-c8db2f467c02 {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:19.001841 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-23c0d5b2-0ee1-436f-80b3-408e3ba585d3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:19.002773 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-23c0d5b2-0ee1-436f-80b3-408e3ba585d3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:19.089442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-23c0d5b2-0ee1-436f-80b3-408e3ba585d3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:19.089760 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5c8a5d3d-5506-463f-9752-348cf1db4d1f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:19.102602 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-23c0d5b2-0ee1-436f-80b3-408e3ba585d3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1258 microversion: 2.1 time: 0.107329 Jul 25 06:03:19.112163 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 326/642] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:18 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1258 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:19.114335 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5c8a5d3d-5506-463f-9752-348cf1db4d1f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 200 len: 1330 microversion: 2.1 time: 0.217394 Jul 25 06:03:19.128275 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 317/643] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:18 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 1330 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:19.134107 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-422b6af0-9e0a-48e8-9171-e4e169e5b905 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:19.135492 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-422b6af0-9e0a-48e8-9171-e4e169e5b905 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:19.148842 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-422b6af0-9e0a-48e8-9171-e4e169e5b905 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:19.149927 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-422b6af0-9e0a-48e8-9171-e4e169e5b905 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:19.151889 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-422b6af0-9e0a-48e8-9171-e4e169e5b905 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:19.152866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-422b6af0-9e0a-48e8-9171-e4e169e5b905 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:19.366908 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-422b6af0-9e0a-48e8-9171-e4e169e5b905 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:19.378305 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-422b6af0-9e0a-48e8-9171-e4e169e5b905 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.252523 Jul 25 06:03:19.383031 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 327/644] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:19 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:19.824401 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3728e935-3e11-43d2-930d-c69618d120e5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:19.824928 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3728e935-3e11-43d2-930d-c69618d120e5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:19.827082 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:19.832125 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3728e935-3e11-43d2-930d-c69618d120e5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:19.834761 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3728e935-3e11-43d2-930d-c69618d120e5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:19.839194 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3728e935-3e11-43d2-930d-c69618d120e5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:19.839194 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3728e935-3e11-43d2-930d-c69618d120e5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:20.046133 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3728e935-3e11-43d2-930d-c69618d120e5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:20.055518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3728e935-3e11-43d2-930d-c69618d120e5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1678 microversion: 2.1 time: 0.235355 Jul 25 06:03:20.065650 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 318/645] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:19 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:20.123726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-bd81bf5b-fc4f-4a70-a896-e4d81be5ffd1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:20.124280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-bd81bf5b-fc4f-4a70-a896-e4d81be5ffd1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:20.131169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bd81bf5b-fc4f-4a70-a896-e4d81be5ffd1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:20.132149 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bd81bf5b-fc4f-4a70-a896-e4d81be5ffd1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:20.138445 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6ad973ab-fd5f-4db5-b442-8465c9d82c77 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:20.139255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6ad973ab-fd5f-4db5-b442-8465c9d82c77 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:20.145688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bd81bf5b-fc4f-4a70-a896-e4d81be5ffd1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:20.146707 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bd81bf5b-fc4f-4a70-a896-e4d81be5ffd1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:20.148492 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6ad973ab-fd5f-4db5-b442-8465c9d82c77 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:20.152355 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6ad973ab-fd5f-4db5-b442-8465c9d82c77 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:20.153334 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6ad973ab-fd5f-4db5-b442-8465c9d82c77 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:20.153774 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6ad973ab-fd5f-4db5-b442-8465c9d82c77 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:20.170923 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-6ad973ab-fd5f-4db5-b442-8465c9d82c77 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6ad973ab-fd5f-4db5-b442-8465c9d82c77 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 HTTP/1.1 Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:03:20.172905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:03:20.174696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'efb335ec-f540-494a-a2c7-c8db2f467c02'} Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:03:20.175570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:03:20.176922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:20.178855 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6ad973ab-fd5f-4db5-b442-8465c9d82c77 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:03:20.179720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6ad973ab-fd5f-4db5-b442-8465c9d82c77 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 404 len: 111 microversion: 2.1 time: 0.046145 Jul 25 06:03:20.180989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 319/646] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:20 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:03:20.191566 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8f835c0d-ad79-4d77-9b96-0d78c4fbfd28 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531e6da60>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:20.241211 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-bd81bf5b-fc4f-4a70-a896-e4d81be5ffd1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:20.250050 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-bd81bf5b-fc4f-4a70-a896-e4d81be5ffd1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1310 microversion: 2.1 time: 0.131839 Jul 25 06:03:20.251059 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 328/647] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:20 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1310 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:20.271176 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8f835c0d-ad79-4d77-9b96-0d78c4fbfd28 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-716786813" status: 202 len: 0 microversion: 2.1 time: 0.084787 Jul 25 06:03:20.272074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 320/648] 10.222.0.40 () {58 vars in 1217 bytes} [Mon Jul 25 06:03:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-716786813 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:03:20.399483 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0ba13350-56f3-4648-af69-9f9db0ec9517 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:20.400020 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0ba13350-56f3-4648-af69-9f9db0ec9517 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:20.406838 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ba13350-56f3-4648-af69-9f9db0ec9517 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:20.407462 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ba13350-56f3-4648-af69-9f9db0ec9517 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:20.408286 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ba13350-56f3-4648-af69-9f9db0ec9517 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:20.408730 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ba13350-56f3-4648-af69-9f9db0ec9517 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:20.638614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0ba13350-56f3-4648-af69-9f9db0ec9517 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:20.659021 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0ba13350-56f3-4648-af69-9f9db0ec9517 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.263784 Jul 25 06:03:20.660174 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 329/649] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:20 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:21.076511 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-296fef26-aa34-48e3-87dc-3aea05c4f8b6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:21.077848 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-296fef26-aa34-48e3-87dc-3aea05c4f8b6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:21.087344 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-296fef26-aa34-48e3-87dc-3aea05c4f8b6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:21.088526 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-296fef26-aa34-48e3-87dc-3aea05c4f8b6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:21.089750 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-296fef26-aa34-48e3-87dc-3aea05c4f8b6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:21.090707 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-296fef26-aa34-48e3-87dc-3aea05c4f8b6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:21.271324 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-67d5c0ea-2b82-4d1d-a863-f9ddec7d3724 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:21.272729 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-67d5c0ea-2b82-4d1d-a863-f9ddec7d3724 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:21.289560 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-67d5c0ea-2b82-4d1d-a863-f9ddec7d3724 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:21.290418 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-67d5c0ea-2b82-4d1d-a863-f9ddec7d3724 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:21.293406 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-67d5c0ea-2b82-4d1d-a863-f9ddec7d3724 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:21.294350 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-67d5c0ea-2b82-4d1d-a863-f9ddec7d3724 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:21.363473 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-296fef26-aa34-48e3-87dc-3aea05c4f8b6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:21.394869 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-296fef26-aa34-48e3-87dc-3aea05c4f8b6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1678 microversion: 2.1 time: 0.309894 Jul 25 06:03:21.394869 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 321/650] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:21 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1678 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:21.421789 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-43b7587a-63dd-406a-b87c-09b9a007425f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6531d19b80>, body: {"keypair": {"name": "tempest-keypair-97086995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFE766C1kejj0DTNFLnQVwymK0x2vY0t1R8F4/lb3CwRBNJ9E+X3M/QFZkITsRqijqDWfAH5t8gHZfg1EZe0RNHWnKXRstSLqH2+K5VNrn/TskoDWXSx5wf5B2e4+vqUg=="}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:21.430123 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-67d5c0ea-2b82-4d1d-a863-f9ddec7d3724 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:21.440871 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-43b7587a-63dd-406a-b87c-09b9a007425f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:03:21.445300 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-43b7587a-63dd-406a-b87c-09b9a007425f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for user 8eedefd8d94047478663ceab8962d738 and project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:03:21.461764 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-67d5c0ea-2b82-4d1d-a863-f9ddec7d3724 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1316 microversion: 2.1 time: 0.194672 Jul 25 06:03:21.473303 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 330/651] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:21 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:21.572900 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-43b7587a-63dd-406a-b87c-09b9a007425f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.155157 Jul 25 06:03:21.584488 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 322/652] 10.222.0.40 () {60 vars in 1158 bytes} [Mon Jul 25 06:03:21 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:21.679019 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5f3da3b5-3fa9-44fd-93a3-02fb274d5063 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:21.679963 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5f3da3b5-3fa9-44fd-93a3-02fb274d5063 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:21.687059 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5f3da3b5-3fa9-44fd-93a3-02fb274d5063 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:21.687553 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5f3da3b5-3fa9-44fd-93a3-02fb274d5063 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:21.688547 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5f3da3b5-3fa9-44fd-93a3-02fb274d5063 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:21.688981 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5f3da3b5-3fa9-44fd-93a3-02fb274d5063 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:21.982191 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5f3da3b5-3fa9-44fd-93a3-02fb274d5063 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:21.993362 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5f3da3b5-3fa9-44fd-93a3-02fb274d5063 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.321072 Jul 25 06:03:22.007477 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 331/653] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:21 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:22.398594 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2df8fe44-603c-4617-a958-2d4e06aeec81 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:22.399201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2df8fe44-603c-4617-a958-2d4e06aeec81 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:22.407797 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2df8fe44-603c-4617-a958-2d4e06aeec81 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:22.408288 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2df8fe44-603c-4617-a958-2d4e06aeec81 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:22.409067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2df8fe44-603c-4617-a958-2d4e06aeec81 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:22.409923 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2df8fe44-603c-4617-a958-2d4e06aeec81 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:22.483848 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-08326be7-6050-4494-9b20-69f9da685255 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:22.489113 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-08326be7-6050-4494-9b20-69f9da685255 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:22.509490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-08326be7-6050-4494-9b20-69f9da685255 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:22.510964 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-08326be7-6050-4494-9b20-69f9da685255 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:22.517378 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-08326be7-6050-4494-9b20-69f9da685255 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:22.518193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-08326be7-6050-4494-9b20-69f9da685255 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:22.642796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2df8fe44-603c-4617-a958-2d4e06aeec81 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:22.655208 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2df8fe44-603c-4617-a958-2d4e06aeec81 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1655 microversion: 2.1 time: 0.260515 Jul 25 06:03:22.655852 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 323/654] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:22 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1655 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:22.695176 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-11bd5e2e-3750-46ef-99df-44243758155b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Action: 'action', calling method: <bound method ServersController._start_server of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f3c8b0>>, body: {"os-start": {}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:22.712795 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-11bd5e2e-3750-46ef-99df-44243758155b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:22.716409 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-11bd5e2e-3750-46ef-99df-44243758155b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:22.756420 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-11bd5e2e-3750-46ef-99df-44243758155b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Going to try to start instance {{(pid=124918) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 06:03:22.827814 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-08326be7-6050-4494-9b20-69f9da685255 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:22.842844 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-08326be7-6050-4494-9b20-69f9da685255 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.366784 Jul 25 06:03:22.846903 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 332/655] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:22 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:22.972875 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-11bd5e2e-3750-46ef-99df-44243758155b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "POST /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/action" status: 202 len: 0 microversion: 2.1 time: 0.300664 Jul 25 06:03:22.997067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 324/656] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:03:22 2022] POST /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:03:23.003033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7143f194-cfaa-497f-9637-a5702d99d66a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:23.003033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7143f194-cfaa-497f-9637-a5702d99d66a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:23.029994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c1034a0f-555e-4a60-b857-baffa772ecdd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:23.033838 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c1034a0f-555e-4a60-b857-baffa772ecdd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:23.038606 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7143f194-cfaa-497f-9637-a5702d99d66a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:23.039400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7143f194-cfaa-497f-9637-a5702d99d66a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:23.042126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7143f194-cfaa-497f-9637-a5702d99d66a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:23.048714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c1034a0f-555e-4a60-b857-baffa772ecdd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:23.049645 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7143f194-cfaa-497f-9637-a5702d99d66a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:23.057757 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c1034a0f-555e-4a60-b857-baffa772ecdd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:23.060381 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c1034a0f-555e-4a60-b857-baffa772ecdd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:23.063891 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c1034a0f-555e-4a60-b857-baffa772ecdd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:23.303703 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c1034a0f-555e-4a60-b857-baffa772ecdd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:23.317566 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c1034a0f-555e-4a60-b857-baffa772ecdd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.303870 Jul 25 06:03:23.319468 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 325/657] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:23 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:23.565782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7143f194-cfaa-497f-9637-a5702d99d66a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:23.581851 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7143f194-cfaa-497f-9637-a5702d99d66a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1664 microversion: 2.1 time: 0.598827 Jul 25 06:03:23.605076 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 333/658] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:22 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1664 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:23.862974 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-95d479a1-5e9d-46ee-a6f2-848743dc1fef tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:23.863690 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-95d479a1-5e9d-46ee-a6f2-848743dc1fef tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:23.877894 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95d479a1-5e9d-46ee-a6f2-848743dc1fef tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:23.879332 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95d479a1-5e9d-46ee-a6f2-848743dc1fef tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:23.885195 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95d479a1-5e9d-46ee-a6f2-848743dc1fef tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:23.893773 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95d479a1-5e9d-46ee-a6f2-848743dc1fef tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:24.311294 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-95d479a1-5e9d-46ee-a6f2-848743dc1fef tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:24.324363 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-95d479a1-5e9d-46ee-a6f2-848743dc1fef tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.465247 Jul 25 06:03:24.325443 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 326/659] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:23 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:24.339772 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6096dd3f-5b6c-46b8-8d01-871148a289c2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:24.340732 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6096dd3f-5b6c-46b8-8d01-871148a289c2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:24.352267 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6096dd3f-5b6c-46b8-8d01-871148a289c2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:24.352527 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6096dd3f-5b6c-46b8-8d01-871148a289c2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:24.364789 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6096dd3f-5b6c-46b8-8d01-871148a289c2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:24.365760 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6096dd3f-5b6c-46b8-8d01-871148a289c2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:24.385754 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-bce9eab7-8695-4c23-88e1-ad4c872224f1 req-4566c762-0e5a-4796-9022-9a97aaa81571 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "4c88e17a-19b8-4f75-bbe7-01c014030a3a", "tag": "279fa404-535f-4110-9863-de45be0f04f9"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:24.407163 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-bce9eab7-8695-4c23-88e1-ad4c872224f1 req-4566c762-0e5a-4796-9022-9a97aaa81571 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:24.407733 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-bce9eab7-8695-4c23-88e1-ad4c872224f1 req-4566c762-0e5a-4796-9022-9a97aaa81571 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:24.443337 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-bce9eab7-8695-4c23-88e1-ad4c872224f1 req-4566c762-0e5a-4796-9022-9a97aaa81571 service nova] Creating event network-changed:279fa404-535f-4110-9863-de45be0f04f9 for instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a on hv-cinder-84841 Jul 25 06:03:24.460156 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-bce9eab7-8695-4c23-88e1-ad4c872224f1 req-4566c762-0e5a-4796-9022-9a97aaa81571 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078980 Jul 25 06:03:24.461938 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 327/660] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:24.613241 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-32e36540-2ef2-41ed-8143-17d004019521 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:24.613887 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-32e36540-2ef2-41ed-8143-17d004019521 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:24.630335 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32e36540-2ef2-41ed-8143-17d004019521 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:24.630987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32e36540-2ef2-41ed-8143-17d004019521 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:24.631785 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32e36540-2ef2-41ed-8143-17d004019521 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:24.632281 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32e36540-2ef2-41ed-8143-17d004019521 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:24.698994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6096dd3f-5b6c-46b8-8d01-871148a289c2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:24.717045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6096dd3f-5b6c-46b8-8d01-871148a289c2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.379159 Jul 25 06:03:24.722218 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 334/661] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:24 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:25.342384 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-473980d3-d0d7-48af-bd5b-ccd6f8eab7fe tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:25.343266 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-473980d3-d0d7-48af-bd5b-ccd6f8eab7fe tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:25.355241 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-473980d3-d0d7-48af-bd5b-ccd6f8eab7fe tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:25.355977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-473980d3-d0d7-48af-bd5b-ccd6f8eab7fe tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:25.361090 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-473980d3-d0d7-48af-bd5b-ccd6f8eab7fe tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:25.361736 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-473980d3-d0d7-48af-bd5b-ccd6f8eab7fe tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:25.543759 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-32e36540-2ef2-41ed-8143-17d004019521 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:25.567667 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-32e36540-2ef2-41ed-8143-17d004019521 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1664 microversion: 2.1 time: 0.959532 Jul 25 06:03:25.571567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 328/662] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:24 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1664 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:25.736760 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-dd844343-3a15-40f3-a68e-49caa9a98592 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:25.737499 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-dd844343-3a15-40f3-a68e-49caa9a98592 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:25.755798 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dd844343-3a15-40f3-a68e-49caa9a98592 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:25.755798 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dd844343-3a15-40f3-a68e-49caa9a98592 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:25.756812 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dd844343-3a15-40f3-a68e-49caa9a98592 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:25.757084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dd844343-3a15-40f3-a68e-49caa9a98592 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:26.033378 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-473980d3-d0d7-48af-bd5b-ccd6f8eab7fe tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:26.033378 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-473980d3-d0d7-48af-bd5b-ccd6f8eab7fe tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.689061 Jul 25 06:03:26.039778 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 335/663] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:25 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:26.413295 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1904699863", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d80cb7ca-3031-41c9-afe8-b6a4faf27141"}], "security_groups": [{"name": "tempest-securitygroup--1115116483"}], "key_name": "tempest-keypair-97086995", "user_data": "}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:26.630591 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-dd844343-3a15-40f3-a68e-49caa9a98592 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:26.642557 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-dd844343-3a15-40f3-a68e-49caa9a98592 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.911361 Jul 25 06:03:26.647336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 329/664] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:25 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:26.660203 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-db86c974-4caf-4fc5-9d2f-e118ec39a02c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:26.660828 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-db86c974-4caf-4fc5-9d2f-e118ec39a02c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:26.679962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db86c974-4caf-4fc5-9d2f-e118ec39a02c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:26.679962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db86c974-4caf-4fc5-9d2f-e118ec39a02c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:26.679962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db86c974-4caf-4fc5-9d2f-e118ec39a02c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:26.679962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db86c974-4caf-4fc5-9d2f-e118ec39a02c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:26.907961 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-db86c974-4caf-4fc5-9d2f-e118ec39a02c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:26.918047 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-db86c974-4caf-4fc5-9d2f-e118ec39a02c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1664 microversion: 2.1 time: 0.269395 Jul 25 06:03:26.928596 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 330/665] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:26 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1664 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:27.107501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ae7b3dd8-aadd-4891-a816-571c85549d3f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:27.108418 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ae7b3dd8-aadd-4891-a816-571c85549d3f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:27.118595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae7b3dd8-aadd-4891-a816-571c85549d3f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:27.120846 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae7b3dd8-aadd-4891-a816-571c85549d3f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:27.121782 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae7b3dd8-aadd-4891-a816-571c85549d3f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:27.122331 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae7b3dd8-aadd-4891-a816-571c85549d3f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:27.314695 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ae7b3dd8-aadd-4891-a816-571c85549d3f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:27.324021 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ae7b3dd8-aadd-4891-a816-571c85549d3f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.227926 Jul 25 06:03:27.325455 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 331/666] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:27 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:27.567706 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:27.671125 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8de674f1-bd92-4785-be69-d73b714f50dd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:27.671785 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-8de674f1-bd92-4785-be69-d73b714f50dd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:27.679702 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8de674f1-bd92-4785-be69-d73b714f50dd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:27.679702 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8de674f1-bd92-4785-be69-d73b714f50dd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:27.679702 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8de674f1-bd92-4785-be69-d73b714f50dd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:27.679702 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8de674f1-bd92-4785-be69-d73b714f50dd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:27.849639 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8de674f1-bd92-4785-be69-d73b714f50dd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:27.860270 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8de674f1-bd92-4785-be69-d73b714f50dd tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.193090 Jul 25 06:03:27.861631 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 332/667] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:27 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:27.935951 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5b4d14a3-eb77-4a1c-9467-7fd5ee95676c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:27.936855 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5b4d14a3-eb77-4a1c-9467-7fd5ee95676c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:27.946546 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b4d14a3-eb77-4a1c-9467-7fd5ee95676c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:27.949584 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b4d14a3-eb77-4a1c-9467-7fd5ee95676c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:27.950649 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b4d14a3-eb77-4a1c-9467-7fd5ee95676c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:27.953039 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b4d14a3-eb77-4a1c-9467-7fd5ee95676c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:28.163878 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5b4d14a3-eb77-4a1c-9467-7fd5ee95676c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:28.172553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5b4d14a3-eb77-4a1c-9467-7fd5ee95676c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1664 microversion: 2.1 time: 0.241003 Jul 25 06:03:28.187391 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 333/668] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:27 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1664 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:28.341656 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d3aaff97-1c27-4c8d-ad8f-97fabe686a46 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:28.342716 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d3aaff97-1c27-4c8d-ad8f-97fabe686a46 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:28.358396 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d3aaff97-1c27-4c8d-ad8f-97fabe686a46 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:28.358839 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d3aaff97-1c27-4c8d-ad8f-97fabe686a46 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:28.359856 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d3aaff97-1c27-4c8d-ad8f-97fabe686a46 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:28.360533 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d3aaff97-1c27-4c8d-ad8f-97fabe686a46 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:28.574758 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d3aaff97-1c27-4c8d-ad8f-97fabe686a46 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:28.583540 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d3aaff97-1c27-4c8d-ad8f-97fabe686a46 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.246511 Jul 25 06:03:28.597751 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 334/669] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:28 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:28.879494 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c8da0d33-1f8e-4a23-b9b3-4f15966a8c63 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:28.880622 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c8da0d33-1f8e-4a23-b9b3-4f15966a8c63 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:28.887573 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c8da0d33-1f8e-4a23-b9b3-4f15966a8c63 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:28.888024 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c8da0d33-1f8e-4a23-b9b3-4f15966a8c63 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:28.889035 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c8da0d33-1f8e-4a23-b9b3-4f15966a8c63 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:28.889475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c8da0d33-1f8e-4a23-b9b3-4f15966a8c63 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:29.034442 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c8da0d33-1f8e-4a23-b9b3-4f15966a8c63 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:29.043189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c8da0d33-1f8e-4a23-b9b3-4f15966a8c63 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.167932 Jul 25 06:03:29.053346 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 335/670] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:28 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:29.098321 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=8 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:29.194405 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-af6a604f-72a6-4726-a125-38bc77b3d27b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:29.195158 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-af6a604f-72a6-4726-a125-38bc77b3d27b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:29.202164 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af6a604f-72a6-4726-a125-38bc77b3d27b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:29.203522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af6a604f-72a6-4726-a125-38bc77b3d27b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:29.203713 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af6a604f-72a6-4726-a125-38bc77b3d27b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:29.204285 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-af6a604f-72a6-4726-a125-38bc77b3d27b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:29.208702 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:29.347189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-af6a604f-72a6-4726-a125-38bc77b3d27b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:29.356203 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-af6a604f-72a6-4726-a125-38bc77b3d27b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1664 microversion: 2.1 time: 0.165479 Jul 25 06:03:29.357279 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 336/671] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:29 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:29.603263 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fadd54cb-0805-4f1e-8568-e3561130b077 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:29.604481 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-fadd54cb-0805-4f1e-8568-e3561130b077 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:29.611612 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fadd54cb-0805-4f1e-8568-e3561130b077 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:29.612222 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fadd54cb-0805-4f1e-8568-e3561130b077 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:29.613069 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fadd54cb-0805-4f1e-8568-e3561130b077 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:29.613663 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fadd54cb-0805-4f1e-8568-e3561130b077 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:29.765952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-fadd54cb-0805-4f1e-8568-e3561130b077 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:29.785480 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-fadd54cb-0805-4f1e-8568-e3561130b077 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.187773 Jul 25 06:03:29.786614 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 337/672] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:29 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:30.061844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-16a6fe84-0847-4d6c-a713-f934cb9ff842 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:30.062817 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-16a6fe84-0847-4d6c-a713-f934cb9ff842 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:30.070097 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16a6fe84-0847-4d6c-a713-f934cb9ff842 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.070775 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16a6fe84-0847-4d6c-a713-f934cb9ff842 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.071505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16a6fe84-0847-4d6c-a713-f934cb9ff842 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.071992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16a6fe84-0847-4d6c-a713-f934cb9ff842 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.215255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-16a6fe84-0847-4d6c-a713-f934cb9ff842 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:30.224212 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-16a6fe84-0847-4d6c-a713-f934cb9ff842 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.166186 Jul 25 06:03:30.224790 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 338/673] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:30 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:30.374825 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7f3d1443-5ff9-4659-b033-864e6600a1db tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:30.375827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7f3d1443-5ff9-4659-b033-864e6600a1db tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:30.382708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7f3d1443-5ff9-4659-b033-864e6600a1db tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.383157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7f3d1443-5ff9-4659-b033-864e6600a1db tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.383929 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7f3d1443-5ff9-4659-b033-864e6600a1db tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.384385 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7f3d1443-5ff9-4659-b033-864e6600a1db tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.543250 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7f3d1443-5ff9-4659-b033-864e6600a1db tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:30.559446 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7f3d1443-5ff9-4659-b033-864e6600a1db tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1664 microversion: 2.1 time: 0.189037 Jul 25 06:03:30.564335 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 339/674] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:30 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1664 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:30.805018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0e3d7210-76d7-40f5-94aa-5a92f76a626c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:30.805018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-0e3d7210-76d7-40f5-94aa-5a92f76a626c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:30.814448 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0e3d7210-76d7-40f5-94aa-5a92f76a626c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.814975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0e3d7210-76d7-40f5-94aa-5a92f76a626c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:30.815950 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0e3d7210-76d7-40f5-94aa-5a92f76a626c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:30.816814 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0e3d7210-76d7-40f5-94aa-5a92f76a626c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:31.001004 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-0e3d7210-76d7-40f5-94aa-5a92f76a626c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:31.013292 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0e3d7210-76d7-40f5-94aa-5a92f76a626c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.213291 Jul 25 06:03:31.013902 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 340/675] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:30 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:31.246254 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-19df6ad0-23a9-46ca-9855-11a80d3a715c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:31.248142 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-19df6ad0-23a9-46ca-9855-11a80d3a715c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:31.263821 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-19df6ad0-23a9-46ca-9855-11a80d3a715c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:31.265468 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-19df6ad0-23a9-46ca-9855-11a80d3a715c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:31.268508 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-19df6ad0-23a9-46ca-9855-11a80d3a715c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:31.269780 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-19df6ad0-23a9-46ca-9855-11a80d3a715c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:31.433160 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-19df6ad0-23a9-46ca-9855-11a80d3a715c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:31.444730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-19df6ad0-23a9-46ca-9855-11a80d3a715c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.206440 Jul 25 06:03:31.468258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 341/676] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:31 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:31.587820 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-aeb5a362-2ea0-4e82-808e-54c8bc9017f5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:31.590185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-aeb5a362-2ea0-4e82-808e-54c8bc9017f5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:31.601048 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=10 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:31.602986 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-aeb5a362-2ea0-4e82-808e-54c8bc9017f5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:31.603680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-aeb5a362-2ea0-4e82-808e-54c8bc9017f5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:31.604847 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-aeb5a362-2ea0-4e82-808e-54c8bc9017f5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:31.605286 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-aeb5a362-2ea0-4e82-808e-54c8bc9017f5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:31.823809 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-aeb5a362-2ea0-4e82-808e-54c8bc9017f5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:31.833646 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-aeb5a362-2ea0-4e82-808e-54c8bc9017f5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1668 microversion: 2.1 time: 0.254604 Jul 25 06:03:31.844872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 342/677] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:31 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1668 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:31.896519 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] validate_networks() for [('d80cb7ca-3031-41c9-afe8-b6a4faf27141', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:03:32.032446 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-831d438d-8bed-4e02-a97c-85fd56fe1b5c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:32.033172 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-831d438d-8bed-4e02-a97c-85fd56fe1b5c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:32.049424 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-831d438d-8bed-4e02-a97c-85fd56fe1b5c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:32.049918 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-831d438d-8bed-4e02-a97c-85fd56fe1b5c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:32.050742 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-831d438d-8bed-4e02-a97c-85fd56fe1b5c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:32.051181 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-831d438d-8bed-4e02-a97c-85fd56fe1b5c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:32.217454 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-831d438d-8bed-4e02-a97c-85fd56fe1b5c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:32.233672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-831d438d-8bed-4e02-a97c-85fd56fe1b5c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.204923 Jul 25 06:03:32.234650 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 343/678] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:32 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:32.327582 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:03:32.328100 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:03:32.328628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:03:32.329124 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:03:32.329538 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:03:32.339289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:32.339734 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:32.340575 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:32.341013 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:32.358951 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:03:32.362763 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for user 8eedefd8d94047478663ceab8962d738 and project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:03:32.374615 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:03:32.376783 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:03:32.465080 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-794271e4-dfbc-4079-884d-90aa5758cb3f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:32.467262 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-794271e4-dfbc-4079-884d-90aa5758cb3f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:32.474077 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-794271e4-dfbc-4079-884d-90aa5758cb3f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:32.474523 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-794271e4-dfbc-4079-884d-90aa5758cb3f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:32.475326 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-794271e4-dfbc-4079-884d-90aa5758cb3f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:32.475761 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-794271e4-dfbc-4079-884d-90aa5758cb3f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:32.532939 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6dbc304e-624d-45ec-b519-29cc0f3f393f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.127955 Jul 25 06:03:32.540263 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 336/679] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:03:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 6136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:03:32.545700 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9e5d5e7f-7821-4244-addc-354a69ab85ae tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:32.546574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9e5d5e7f-7821-4244-addc-354a69ab85ae tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:32.613791 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9e5d5e7f-7821-4244-addc-354a69ab85ae tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:32.621809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9e5d5e7f-7821-4244-addc-354a69ab85ae tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1240 microversion: 2.1 time: 0.080072 Jul 25 06:03:32.632107 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 337/680] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:32 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:32.679374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-794271e4-dfbc-4079-884d-90aa5758cb3f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:32.693019 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-794271e4-dfbc-4079-884d-90aa5758cb3f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.232047 Jul 25 06:03:32.693602 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 344/681] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:32 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:33.251476 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-63efc3f5-5820-4e2a-bd3a-2d791fc3ee2c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:33.252084 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-63efc3f5-5820-4e2a-bd3a-2d791fc3ee2c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:33.258506 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-63efc3f5-5820-4e2a-bd3a-2d791fc3ee2c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:33.258954 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-63efc3f5-5820-4e2a-bd3a-2d791fc3ee2c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:33.260791 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-63efc3f5-5820-4e2a-bd3a-2d791fc3ee2c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:33.261262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-63efc3f5-5820-4e2a-bd3a-2d791fc3ee2c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:33.407809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-63efc3f5-5820-4e2a-bd3a-2d791fc3ee2c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:33.415555 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-63efc3f5-5820-4e2a-bd3a-2d791fc3ee2c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.168012 Jul 25 06:03:33.418042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 338/682] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:33 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:33.639967 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-82aed4af-bab3-4434-a9e8-90877c0070dc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:33.640587 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-82aed4af-bab3-4434-a9e8-90877c0070dc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:33.647319 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-82aed4af-bab3-4434-a9e8-90877c0070dc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:33.647760 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-82aed4af-bab3-4434-a9e8-90877c0070dc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:33.648553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-82aed4af-bab3-4434-a9e8-90877c0070dc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:33.649030 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-82aed4af-bab3-4434-a9e8-90877c0070dc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:33.710945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b999d418-36ab-412a-8cc9-50ad302d7ad5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:33.711849 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b999d418-36ab-412a-8cc9-50ad302d7ad5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:33.714773 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-82aed4af-bab3-4434-a9e8-90877c0070dc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:33.720136 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b999d418-36ab-412a-8cc9-50ad302d7ad5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:33.720691 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b999d418-36ab-412a-8cc9-50ad302d7ad5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:33.721563 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b999d418-36ab-412a-8cc9-50ad302d7ad5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:33.722093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b999d418-36ab-412a-8cc9-50ad302d7ad5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:33.722588 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-82aed4af-bab3-4434-a9e8-90877c0070dc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1244 microversion: 2.1 time: 0.086819 Jul 25 06:03:33.723538 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 345/683] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:33 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:33.743282 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:33.869034 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b999d418-36ab-412a-8cc9-50ad302d7ad5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:33.877806 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b999d418-36ab-412a-8cc9-50ad302d7ad5 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.170859 Jul 25 06:03:33.878395 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 339/684] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:33 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:34.433752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d7eaa05a-2c2f-408c-969f-ea152a4d5796 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:34.434368 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d7eaa05a-2c2f-408c-969f-ea152a4d5796 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:34.440507 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d7eaa05a-2c2f-408c-969f-ea152a4d5796 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:34.440958 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d7eaa05a-2c2f-408c-969f-ea152a4d5796 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:34.441731 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d7eaa05a-2c2f-408c-969f-ea152a4d5796 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:34.442175 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d7eaa05a-2c2f-408c-969f-ea152a4d5796 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:34.579566 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d7eaa05a-2c2f-408c-969f-ea152a4d5796 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:34.591843 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d7eaa05a-2c2f-408c-969f-ea152a4d5796 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.162429 Jul 25 06:03:34.592485 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 346/685] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:34 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:34.740435 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-227ac3cd-b7c1-4d81-9312-5af08923a3e0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:34.741103 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-227ac3cd-b7c1-4d81-9312-5af08923a3e0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:34.748746 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-227ac3cd-b7c1-4d81-9312-5af08923a3e0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:34.749527 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-227ac3cd-b7c1-4d81-9312-5af08923a3e0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:34.750376 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-227ac3cd-b7c1-4d81-9312-5af08923a3e0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:34.750897 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-227ac3cd-b7c1-4d81-9312-5af08923a3e0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:34.824043 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-227ac3cd-b7c1-4d81-9312-5af08923a3e0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:34.831912 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-227ac3cd-b7c1-4d81-9312-5af08923a3e0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1244 microversion: 2.1 time: 0.095786 Jul 25 06:03:34.832446 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 340/686] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:34 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:34.894697 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ad82d824-5e0a-42c5-8ab0-e8a7f3c985ba tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:34.895319 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ad82d824-5e0a-42c5-8ab0-e8a7f3c985ba tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:34.906331 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ad82d824-5e0a-42c5-8ab0-e8a7f3c985ba tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:34.906785 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ad82d824-5e0a-42c5-8ab0-e8a7f3c985ba tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:34.907561 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ad82d824-5e0a-42c5-8ab0-e8a7f3c985ba tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:34.908004 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ad82d824-5e0a-42c5-8ab0-e8a7f3c985ba tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:35.044921 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ad82d824-5e0a-42c5-8ab0-e8a7f3c985ba tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:35.053088 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ad82d824-5e0a-42c5-8ab0-e8a7f3c985ba tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.162119 Jul 25 06:03:35.053855 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 347/687] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:34 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:35.609220 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-49f19dc7-f808-415b-9d11-8537167dc186 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:35.609828 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-49f19dc7-f808-415b-9d11-8537167dc186 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:35.616050 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49f19dc7-f808-415b-9d11-8537167dc186 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:35.616640 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49f19dc7-f808-415b-9d11-8537167dc186 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:35.617495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49f19dc7-f808-415b-9d11-8537167dc186 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:35.617925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49f19dc7-f808-415b-9d11-8537167dc186 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:35.765084 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-49f19dc7-f808-415b-9d11-8537167dc186 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:35.776439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-49f19dc7-f808-415b-9d11-8537167dc186 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.170851 Jul 25 06:03:35.777276 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 341/688] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:35 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:35.848487 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-98e6013c-d683-447d-bd02-00cdf2a6c01f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:35.849131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-98e6013c-d683-447d-bd02-00cdf2a6c01f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:35.856064 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-98e6013c-d683-447d-bd02-00cdf2a6c01f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:35.856527 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-98e6013c-d683-447d-bd02-00cdf2a6c01f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:35.857296 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-98e6013c-d683-447d-bd02-00cdf2a6c01f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:35.857778 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-98e6013c-d683-447d-bd02-00cdf2a6c01f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:35.937932 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-98e6013c-d683-447d-bd02-00cdf2a6c01f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:35.950833 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-98e6013c-d683-447d-bd02-00cdf2a6c01f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1244 microversion: 2.1 time: 0.106070 Jul 25 06:03:35.958789 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 348/689] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:35 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1244 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:36.070975 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b8973df8-df03-4989-b2c7-111dd2e3fc72 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:36.071592 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b8973df8-df03-4989-b2c7-111dd2e3fc72 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:36.078672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b8973df8-df03-4989-b2c7-111dd2e3fc72 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:36.079122 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b8973df8-df03-4989-b2c7-111dd2e3fc72 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:36.079894 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b8973df8-df03-4989-b2c7-111dd2e3fc72 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:36.080499 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b8973df8-df03-4989-b2c7-111dd2e3fc72 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:36.222385 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b8973df8-df03-4989-b2c7-111dd2e3fc72 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:36.230516 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b8973df8-df03-4989-b2c7-111dd2e3fc72 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.163666 Jul 25 06:03:36.231080 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 342/690] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:36 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:36.793269 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-13ccbc3b-bcfd-4424-92d0-db94bfd6c583 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:36.793872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-13ccbc3b-bcfd-4424-92d0-db94bfd6c583 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:36.800252 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-13ccbc3b-bcfd-4424-92d0-db94bfd6c583 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:36.800915 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-13ccbc3b-bcfd-4424-92d0-db94bfd6c583 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:36.801658 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-13ccbc3b-bcfd-4424-92d0-db94bfd6c583 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:36.802088 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-13ccbc3b-bcfd-4424-92d0-db94bfd6c583 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:36.931748 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-13ccbc3b-bcfd-4424-92d0-db94bfd6c583 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:36.940183 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-13ccbc3b-bcfd-4424-92d0-db94bfd6c583 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.151117 Jul 25 06:03:36.940790 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 349/691] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:36 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:36.967450 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c8772ed8-2c0c-464a-b2f2-220364b75d60 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:36.968610 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c8772ed8-2c0c-464a-b2f2-220364b75d60 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:36.975257 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c8772ed8-2c0c-464a-b2f2-220364b75d60 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:36.975703 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c8772ed8-2c0c-464a-b2f2-220364b75d60 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:36.976486 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c8772ed8-2c0c-464a-b2f2-220364b75d60 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:36.976954 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c8772ed8-2c0c-464a-b2f2-220364b75d60 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:37.046978 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c8772ed8-2c0c-464a-b2f2-220364b75d60 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:37.057541 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c8772ed8-2c0c-464a-b2f2-220364b75d60 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1244 microversion: 2.1 time: 0.094505 Jul 25 06:03:37.059695 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 343/692] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:36 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:37.248012 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f5541377-97c2-4018-b7ff-b8b06072d303 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:37.248466 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f5541377-97c2-4018-b7ff-b8b06072d303 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:37.255031 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f5541377-97c2-4018-b7ff-b8b06072d303 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:37.255612 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f5541377-97c2-4018-b7ff-b8b06072d303 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:37.256507 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f5541377-97c2-4018-b7ff-b8b06072d303 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:37.257247 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f5541377-97c2-4018-b7ff-b8b06072d303 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:37.394712 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f5541377-97c2-4018-b7ff-b8b06072d303 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:37.403879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f5541377-97c2-4018-b7ff-b8b06072d303 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.160388 Jul 25 06:03:37.404483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 350/693] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:37 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:37.958083 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-efe25d59-af07-457c-ab07-5bb479fa7b04 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:37.958691 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-efe25d59-af07-457c-ab07-5bb479fa7b04 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:37.964977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-efe25d59-af07-457c-ab07-5bb479fa7b04 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:37.965426 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-efe25d59-af07-457c-ab07-5bb479fa7b04 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:37.966175 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-efe25d59-af07-457c-ab07-5bb479fa7b04 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:37.966604 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-efe25d59-af07-457c-ab07-5bb479fa7b04 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:38.075909 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9b6a3e89-8f98-4779-841c-67272f02881b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:38.076637 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9b6a3e89-8f98-4779-841c-67272f02881b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:38.083313 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b6a3e89-8f98-4779-841c-67272f02881b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:38.083786 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b6a3e89-8f98-4779-841c-67272f02881b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:38.084576 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b6a3e89-8f98-4779-841c-67272f02881b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:38.085015 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b6a3e89-8f98-4779-841c-67272f02881b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:38.095890 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-efe25d59-af07-457c-ab07-5bb479fa7b04 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:38.103270 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-efe25d59-af07-457c-ab07-5bb479fa7b04 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.149200 Jul 25 06:03:38.103836 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 344/694] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:37 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:38.154365 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9b6a3e89-8f98-4779-841c-67272f02881b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:38.161811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9b6a3e89-8f98-4779-841c-67272f02881b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1236 microversion: 2.1 time: 0.089798 Jul 25 06:03:38.162380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 351/695] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:38 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:38.421194 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0da7d321-ac50-4919-9765-23a59f6882ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:38.421811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0da7d321-ac50-4919-9765-23a59f6882ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:38.427966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0da7d321-ac50-4919-9765-23a59f6882ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:38.428476 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0da7d321-ac50-4919-9765-23a59f6882ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:38.429239 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0da7d321-ac50-4919-9765-23a59f6882ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:38.429679 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0da7d321-ac50-4919-9765-23a59f6882ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:38.574712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0da7d321-ac50-4919-9765-23a59f6882ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:38.584391 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0da7d321-ac50-4919-9765-23a59f6882ef tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.166412 Jul 25 06:03:38.585485 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 345/696] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:38 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:39.122242 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-499e5444-a59e-4b39-bc46-8dd9104e8d5d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:39.122832 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-499e5444-a59e-4b39-bc46-8dd9104e8d5d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:39.129474 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-499e5444-a59e-4b39-bc46-8dd9104e8d5d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.129913 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-499e5444-a59e-4b39-bc46-8dd9104e8d5d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.130665 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-499e5444-a59e-4b39-bc46-8dd9104e8d5d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.131094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-499e5444-a59e-4b39-bc46-8dd9104e8d5d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.179266 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ab580e28-711a-48f4-87cb-c94a00ec5018 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:39.181236 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ab580e28-711a-48f4-87cb-c94a00ec5018 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:39.187010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ab580e28-711a-48f4-87cb-c94a00ec5018 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.187454 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ab580e28-711a-48f4-87cb-c94a00ec5018 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.188250 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ab580e28-711a-48f4-87cb-c94a00ec5018 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.188687 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ab580e28-711a-48f4-87cb-c94a00ec5018 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.257970 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ab580e28-711a-48f4-87cb-c94a00ec5018 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:39.266799 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ab580e28-711a-48f4-87cb-c94a00ec5018 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1292 microversion: 2.1 time: 0.091193 Jul 25 06:03:39.267470 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 346/697] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:39 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:39.285899 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-499e5444-a59e-4b39-bc46-8dd9104e8d5d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:39.289350 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=100 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:39.293673 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-499e5444-a59e-4b39-bc46-8dd9104e8d5d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.176699 Jul 25 06:03:39.294554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 352/698] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:39 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:39.414175 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-64334b59-3390-49ab-99f4-83ce53a30cdc tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4880>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:39.414669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-64334b59-3390-49ab-99f4-83ce53a30cdc tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:39.421490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64334b59-3390-49ab-99f4-83ce53a30cdc tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.421939 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64334b59-3390-49ab-99f4-83ce53a30cdc tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.422695 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64334b59-3390-49ab-99f4-83ce53a30cdc tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.423130 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-64334b59-3390-49ab-99f4-83ce53a30cdc tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.502137 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-64334b59-3390-49ab-99f4-83ce53a30cdc tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lazy-loading 'services' on Instance uuid 33c564d4-6300-4c60-8829-01e8f445ce7a {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:39.601441 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-298b579c-f4ff-4989-bb86-ecfb5a2923c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:39.602056 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-298b579c-f4ff-4989-bb86-ecfb5a2923c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:39.608694 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-298b579c-f4ff-4989-bb86-ecfb5a2923c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.609144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-298b579c-f4ff-4989-bb86-ecfb5a2923c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.609904 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-298b579c-f4ff-4989-bb86-ecfb5a2923c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:39.610345 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-298b579c-f4ff-4989-bb86-ecfb5a2923c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:39.715189 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-64334b59-3390-49ab-99f4-83ce53a30cdc tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "DELETE /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a/os-volume_attachments/c1eaf0d6-328a-4f63-ba26-fe3defd35e94" status: 202 len: 0 microversion: 2.1 time: 0.304025 Jul 25 06:03:39.722776 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 347/699] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:03:39 2022] DELETE /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a/os-volume_attachments/c1eaf0d6-328a-4f63-ba26-fe3defd35e94 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:03:39.788818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-298b579c-f4ff-4989-bb86-ecfb5a2923c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:39.797212 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-298b579c-f4ff-4989-bb86-ecfb5a2923c9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.199710 Jul 25 06:03:39.798402 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 353/700] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:39 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:40.285076 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-75ba472c-8eeb-4295-97b5-791d89362538 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:40.285906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-75ba472c-8eeb-4295-97b5-791d89362538 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:40.292974 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75ba472c-8eeb-4295-97b5-791d89362538 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:40.293428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75ba472c-8eeb-4295-97b5-791d89362538 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:40.294196 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75ba472c-8eeb-4295-97b5-791d89362538 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:40.294632 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-75ba472c-8eeb-4295-97b5-791d89362538 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:40.317945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5dd5bf80-89b3-442c-9827-f2f1a8924034 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:40.318682 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5dd5bf80-89b3-442c-9827-f2f1a8924034 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:40.325570 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5dd5bf80-89b3-442c-9827-f2f1a8924034 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:40.326020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5dd5bf80-89b3-442c-9827-f2f1a8924034 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:40.326811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5dd5bf80-89b3-442c-9827-f2f1a8924034 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:40.327249 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5dd5bf80-89b3-442c-9827-f2f1a8924034 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:40.366759 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-75ba472c-8eeb-4295-97b5-791d89362538 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:40.380413 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-75ba472c-8eeb-4295-97b5-791d89362538 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1292 microversion: 2.1 time: 0.099876 Jul 25 06:03:40.381021 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 348/701] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:40 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:40.474107 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5dd5bf80-89b3-442c-9827-f2f1a8924034 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:40.483050 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5dd5bf80-89b3-442c-9827-f2f1a8924034 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.169254 Jul 25 06:03:40.483645 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 354/702] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:40 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:40.816224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b687b5b9-8eac-4ee3-92ae-94d95c31ce7f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:40.821409 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b687b5b9-8eac-4ee3-92ae-94d95c31ce7f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:40.824333 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b687b5b9-8eac-4ee3-92ae-94d95c31ce7f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:40.825253 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b687b5b9-8eac-4ee3-92ae-94d95c31ce7f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:40.827200 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b687b5b9-8eac-4ee3-92ae-94d95c31ce7f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:40.827790 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b687b5b9-8eac-4ee3-92ae-94d95c31ce7f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:40.962877 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b687b5b9-8eac-4ee3-92ae-94d95c31ce7f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:40.971054 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b687b5b9-8eac-4ee3-92ae-94d95c31ce7f tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.159863 Jul 25 06:03:40.971619 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 349/703] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:40 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:41.398400 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4ebecb65-323c-4ed3-bddb-ae296f43ba49 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:41.399038 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4ebecb65-323c-4ed3-bddb-ae296f43ba49 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:41.409796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4ebecb65-323c-4ed3-bddb-ae296f43ba49 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:41.411385 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4ebecb65-323c-4ed3-bddb-ae296f43ba49 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:41.412333 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4ebecb65-323c-4ed3-bddb-ae296f43ba49 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:41.413007 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4ebecb65-323c-4ed3-bddb-ae296f43ba49 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:41.483828 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4ebecb65-323c-4ed3-bddb-ae296f43ba49 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:41.491478 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4ebecb65-323c-4ed3-bddb-ae296f43ba49 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1300 microversion: 2.1 time: 0.097530 Jul 25 06:03:41.492049 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 355/704] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:41 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:41.501646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-cf270146-ddb4-4204-82af-5ede06d20b8d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:41.507072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cf270146-ddb4-4204-82af-5ede06d20b8d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:41.509748 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf270146-ddb4-4204-82af-5ede06d20b8d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:41.510196 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf270146-ddb4-4204-82af-5ede06d20b8d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:41.511584 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf270146-ddb4-4204-82af-5ede06d20b8d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:41.512084 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf270146-ddb4-4204-82af-5ede06d20b8d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:41.679524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-cf270146-ddb4-4204-82af-5ede06d20b8d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:41.687624 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-cf270146-ddb4-4204-82af-5ede06d20b8d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.189948 Jul 25 06:03:41.688207 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 350/705] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:41 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:41.988624 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5a305c3c-d1bb-460b-b8a8-7d179f32bff9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:41.989264 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5a305c3c-d1bb-460b-b8a8-7d179f32bff9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:41.996375 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5a305c3c-d1bb-460b-b8a8-7d179f32bff9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:41.996850 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5a305c3c-d1bb-460b-b8a8-7d179f32bff9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:41.997610 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5a305c3c-d1bb-460b-b8a8-7d179f32bff9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:41.998044 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5a305c3c-d1bb-460b-b8a8-7d179f32bff9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:42.164292 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5a305c3c-d1bb-460b-b8a8-7d179f32bff9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:42.173296 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5a305c3c-d1bb-460b-b8a8-7d179f32bff9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1735 microversion: 2.1 time: 0.188782 Jul 25 06:03:42.180679 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 356/706] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:41 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:42.509528 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-de223efb-31a0-43f8-9eca-34a54a006c59 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:42.510067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-de223efb-31a0-43f8-9eca-34a54a006c59 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:42.512039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:42.517878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-de223efb-31a0-43f8-9eca-34a54a006c59 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:42.518323 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-de223efb-31a0-43f8-9eca-34a54a006c59 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:42.519085 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-de223efb-31a0-43f8-9eca-34a54a006c59 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:42.519514 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-de223efb-31a0-43f8-9eca-34a54a006c59 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:42.585421 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-de223efb-31a0-43f8-9eca-34a54a006c59 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:42.593719 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-de223efb-31a0-43f8-9eca-34a54a006c59 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1298 microversion: 2.1 time: 0.088183 Jul 25 06:03:42.594301 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 351/707] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:42 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:42.705548 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6608bf3f-0f40-4ae6-9741-15bf7f882f77 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:42.706270 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6608bf3f-0f40-4ae6-9741-15bf7f882f77 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:42.731739 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6608bf3f-0f40-4ae6-9741-15bf7f882f77 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:42.735200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6608bf3f-0f40-4ae6-9741-15bf7f882f77 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:42.735200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6608bf3f-0f40-4ae6-9741-15bf7f882f77 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:42.735200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6608bf3f-0f40-4ae6-9741-15bf7f882f77 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:42.909393 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6608bf3f-0f40-4ae6-9741-15bf7f882f77 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:42.919593 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6608bf3f-0f40-4ae6-9741-15bf7f882f77 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.218315 Jul 25 06:03:42.920201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 357/708] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:42 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:42.966556 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-093008ad-0cd6-4108-8489-2475dd3f8b69 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:42.966556 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-093008ad-0cd6-4108-8489-2475dd3f8b69 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:42.966556 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=8 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:42.971677 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-093008ad-0cd6-4108-8489-2475dd3f8b69 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:42.972152 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-093008ad-0cd6-4108-8489-2475dd3f8b69 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:42.973149 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-093008ad-0cd6-4108-8489-2475dd3f8b69 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:42.973756 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-093008ad-0cd6-4108-8489-2475dd3f8b69 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.002448 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-093008ad-0cd6-4108-8489-2475dd3f8b69 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Going to try to terminate instance {{(pid=124917) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:03:43.077511 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-216306c1-b3b5-45f9-9c08-db9b59bb5ded req-c9b8c649-9e5e-41b8-8333-6368f72c3022 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "4c88e17a-19b8-4f75-bbe7-01c014030a3a", "name": "network-vif-plugged", "status": "completed", "tag": "279fa404-535f-4110-9863-de45be0f04f9"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:43.086861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-216306c1-b3b5-45f9-9c08-db9b59bb5ded req-c9b8c649-9e5e-41b8-8333-6368f72c3022 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.087458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-216306c1-b3b5-45f9-9c08-db9b59bb5ded req-c9b8c649-9e5e-41b8-8333-6368f72c3022 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.100037 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-216306c1-b3b5-45f9-9c08-db9b59bb5ded req-c9b8c649-9e5e-41b8-8333-6368f72c3022 service nova] Creating event network-vif-plugged:279fa404-535f-4110-9863-de45be0f04f9 for instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a on hv-cinder-84841 Jul 25 06:03:43.105276 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-216306c1-b3b5-45f9-9c08-db9b59bb5ded req-c9b8c649-9e5e-41b8-8333-6368f72c3022 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032366 Jul 25 06:03:43.106515 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 358/709] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:43.193009 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ae1b1f37-1cfe-412b-b6ab-2086dbb04d27 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:43.194006 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ae1b1f37-1cfe-412b-b6ab-2086dbb04d27 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:43.201655 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae1b1f37-1cfe-412b-b6ab-2086dbb04d27 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.202206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae1b1f37-1cfe-412b-b6ab-2086dbb04d27 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.203102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae1b1f37-1cfe-412b-b6ab-2086dbb04d27 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.203789 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae1b1f37-1cfe-412b-b6ab-2086dbb04d27 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.233047 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:43.318853 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-093008ad-0cd6-4108-8489-2475dd3f8b69 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "DELETE /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 204 len: 0 microversion: 2.1 time: 0.358651 Jul 25 06:03:43.319753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 352/710] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:03:42 2022] DELETE /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:03:43.334761 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-53b999cc-1955-49b3-a9c3-d494c743a9b4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:43.335697 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-53b999cc-1955-49b3-a9c3-d494c743a9b4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:43.342051 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-53b999cc-1955-49b3-a9c3-d494c743a9b4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.342618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-53b999cc-1955-49b3-a9c3-d494c743a9b4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.343479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-53b999cc-1955-49b3-a9c3-d494c743a9b4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.344023 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-53b999cc-1955-49b3-a9c3-d494c743a9b4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.351669 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ae1b1f37-1cfe-412b-b6ab-2086dbb04d27 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:43.363449 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ae1b1f37-1cfe-412b-b6ab-2086dbb04d27 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1715 microversion: 2.1 time: 0.175170 Jul 25 06:03:43.364737 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 359/711] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:43 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1715 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:43.468157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1803a791-d5ee-4238-b495-1634c212c946 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4850>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:43.468649 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1803a791-d5ee-4238-b495-1634c212c946 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:43.474544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1803a791-d5ee-4238-b495-1634c212c946 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.477839 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1803a791-d5ee-4238-b495-1634c212c946 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.477839 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1803a791-d5ee-4238-b495-1634c212c946 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.477839 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1803a791-d5ee-4238-b495-1634c212c946 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.558537 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-1803a791-d5ee-4238-b495-1634c212c946 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] HTTP exception thrown: Cannot 'detach_volume' instance e750488b-116b-4f02-a4bd-710c3867fa27 while it is in vm_state rescued Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1803a791-d5ee-4238-b495-1634c212c946 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Request method failure captured: Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: DELETE /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-volume_attachments/2d82e4b9-5a46-49a2-b9a1-3625c146b23d HTTP/1.1 Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFNLWQeCYHz8Io1IOt6Hr-lMqJ9K-YweQE3M09yh5R7VR6PG1vMjGfytjWdlaoZHzEo1B_oyLz7Zah8DrhHF8tlpaMtpzBWgxpFZSG7xixeUC3XpV_tpocgpoF3BlRnF2cUrT4CpeLoCBBUGjv0RwbBYMNZ8LqFjtnv-2kVRjdbEIg Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: 07562543fa3e40d584b4d4525b112319 Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:03:43.563930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:03:43.565611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/07562543fa3e40d584b4d4525b112319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07562543fa3e40d584b4d4525b112319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_07562543fa3e40d584b4d4525b112319", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07562543fa3e40d584b4d4525b112319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:03:43.565611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:03:43.565611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: 07562543fa3e40d584b4d4525b112319 Jul 25 06:03:43.565611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:03:43.565611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-ServerRescueNegativeTestJSON-1718876686-project Jul 25 06:03:43.565611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:03:43.565611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:03:43.565611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 62e566aa74b045cb8cc6e8edf4a256e1 Jul 25 06:03:43.565611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718876686-project Jul 25 06:03:43.565611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4850>> Jul 25 06:03:43.565611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Cannot 'detach_volume' instance e750488b-116b-4f02-a4bd-710c3867fa27 while it is in vm_state rescued Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'server_id': 'e750488b-116b-4f02-a4bd-710c3867fa27', 'id': '2d82e4b9-5a46-49a2-b9a1-3625c146b23d'} Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e750488b-116b-4f02-a4bd-710c3867fa27 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:03:43.566374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e750488b-116b-4f02-a4bd-710c3867fa27 while it is in vm_state rescued Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e750488b-116b-4f02-a4bd-710c3867fa27 while it is in vm_state rescued Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:43.568189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1803a791-d5ee-4238-b495-1634c212c946 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Returning 409 to user: Cannot 'detach_volume' instance e750488b-116b-4f02-a4bd-710c3867fa27 while it is in vm_state rescued {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:03:43.569520 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1803a791-d5ee-4238-b495-1634c212c946 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-volume_attachments/2d82e4b9-5a46-49a2-b9a1-3625c146b23d" status: 409 len: 152 microversion: 2.1 time: 0.098214 Jul 25 06:03:43.569520 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 360/712] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:03:43 2022] DELETE /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-volume_attachments/2d82e4b9-5a46-49a2-b9a1-3625c146b23d => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 06:03:43.570948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-16c818e6-16e9-45b9-8116-ec73f873a809 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Action: 'action', calling method: <bound method RescueController._unrescue of <nova.api.openstack.compute.rescue.RescueController object at 0x7f6533ed8e50>>, body: {"unrescue": {}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:43.571472 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-16c818e6-16e9-45b9-8116-ec73f873a809 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:43.572264 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-53b999cc-1955-49b3-a9c3-d494c743a9b4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:43.575787 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:43.578402 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16c818e6-16e9-45b9-8116-ec73f873a809 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.578843 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16c818e6-16e9-45b9-8116-ec73f873a809 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.579604 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16c818e6-16e9-45b9-8116-ec73f873a809 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.580048 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16c818e6-16e9-45b9-8116-ec73f873a809 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.581100 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-53b999cc-1955-49b3-a9c3-d494c743a9b4 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1513 microversion: 2.1 time: 0.250535 Jul 25 06:03:43.582001 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 353/713] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:43 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:43.615144 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-cf674083-9753-4f53-9195-7f9a696b26a4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:43.615802 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cf674083-9753-4f53-9195-7f9a696b26a4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:43.622827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf674083-9753-4f53-9195-7f9a696b26a4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.623264 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf674083-9753-4f53-9195-7f9a696b26a4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.624224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf674083-9753-4f53-9195-7f9a696b26a4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.624803 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf674083-9753-4f53-9195-7f9a696b26a4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.850041 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-cf674083-9753-4f53-9195-7f9a696b26a4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:43.858317 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-cf674083-9753-4f53-9195-7f9a696b26a4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.247349 Jul 25 06:03:43.858899 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 354/714] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:43 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:43.869531 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-16c818e6-16e9-45b9-8116-ec73f873a809 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "POST /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/action" status: 202 len: 0 microversion: 2.1 time: 0.302135 Jul 25 06:03:43.876324 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 361/715] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:03:43 2022] POST /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 06:03:43.883744 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3e8b754b-8860-4741-936a-a19f1fb332cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:43.884496 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3e8b754b-8860-4741-936a-a19f1fb332cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:43.890960 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3e8b754b-8860-4741-936a-a19f1fb332cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.891975 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3e8b754b-8860-4741-936a-a19f1fb332cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.893332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3e8b754b-8860-4741-936a-a19f1fb332cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.894237 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3e8b754b-8860-4741-936a-a19f1fb332cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.944790 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-284877a4-1f0d-4ff8-a26c-c521cc685d4d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:43.945601 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-284877a4-1f0d-4ff8-a26c-c521cc685d4d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:43.947899 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:43.953382 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-284877a4-1f0d-4ff8-a26c-c521cc685d4d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.953900 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-284877a4-1f0d-4ff8-a26c-c521cc685d4d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:43.954733 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-284877a4-1f0d-4ff8-a26c-c521cc685d4d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:43.955230 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-284877a4-1f0d-4ff8-a26c-c521cc685d4d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.106500 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3e8b754b-8860-4741-936a-a19f1fb332cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:44.106500 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3e8b754b-8860-4741-936a-a19f1fb332cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1723 microversion: 2.1 time: 0.219047 Jul 25 06:03:44.106500 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 355/716] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:43 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:44.109785 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-284877a4-1f0d-4ff8-a26c-c521cc685d4d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:44.117911 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-284877a4-1f0d-4ff8-a26c-c521cc685d4d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.183941 Jul 25 06:03:44.118479 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 362/717] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:43 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:44.513388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-178df0a4-ab54-4005-ae07-fe68e4f083dc req-a50db2bc-9cfe-4d1e-a9c3-68641b4995af service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "8fd12755-30ea-4aa4-94ce-e18ed9c29559", "tag": "6e112229-0732-4652-b953-cf6548e850ee"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:44.524968 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-178df0a4-ab54-4005-ae07-fe68e4f083dc req-a50db2bc-9cfe-4d1e-a9c3-68641b4995af service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.525553 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-178df0a4-ab54-4005-ae07-fe68e4f083dc req-a50db2bc-9cfe-4d1e-a9c3-68641b4995af service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.539665 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-178df0a4-ab54-4005-ae07-fe68e4f083dc req-a50db2bc-9cfe-4d1e-a9c3-68641b4995af service nova] Creating event network-changed:6e112229-0732-4652-b953-cf6548e850ee for instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 on hv-cinder-84841 Jul 25 06:03:44.544957 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-178df0a4-ab54-4005-ae07-fe68e4f083dc req-a50db2bc-9cfe-4d1e-a9c3-68641b4995af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036254 Jul 25 06:03:44.549954 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 356/718] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:44.598917 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-336ad28f-fdfe-40f7-b7fa-e12bd8d1ac82 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:44.599557 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-336ad28f-fdfe-40f7-b7fa-e12bd8d1ac82 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:44.605900 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-336ad28f-fdfe-40f7-b7fa-e12bd8d1ac82 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.606370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-336ad28f-fdfe-40f7-b7fa-e12bd8d1ac82 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.607427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-336ad28f-fdfe-40f7-b7fa-e12bd8d1ac82 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.607861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-336ad28f-fdfe-40f7-b7fa-e12bd8d1ac82 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.748355 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-336ad28f-fdfe-40f7-b7fa-e12bd8d1ac82 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:44.756380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-336ad28f-fdfe-40f7-b7fa-e12bd8d1ac82 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1513 microversion: 2.1 time: 0.161508 Jul 25 06:03:44.756951 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 363/719] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:44 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:44.876346 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3db8589d-4d9b-45cb-83af-7bce346f96b6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:44.877050 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3db8589d-4d9b-45cb-83af-7bce346f96b6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:44.883911 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3db8589d-4d9b-45cb-83af-7bce346f96b6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.884383 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3db8589d-4d9b-45cb-83af-7bce346f96b6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:44.885177 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3db8589d-4d9b-45cb-83af-7bce346f96b6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:44.885612 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3db8589d-4d9b-45cb-83af-7bce346f96b6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:45.049166 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3db8589d-4d9b-45cb-83af-7bce346f96b6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:45.056482 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3db8589d-4d9b-45cb-83af-7bce346f96b6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.185193 Jul 25 06:03:45.057039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 357/720] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:44 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:45.117355 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-36b20ee7-4aa6-4881-83f6-82673f3b4a9d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:45.117985 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-36b20ee7-4aa6-4881-83f6-82673f3b4a9d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:45.125167 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-36b20ee7-4aa6-4881-83f6-82673f3b4a9d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:45.125678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-36b20ee7-4aa6-4881-83f6-82673f3b4a9d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:45.126378 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-36b20ee7-4aa6-4881-83f6-82673f3b4a9d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:45.126807 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-36b20ee7-4aa6-4881-83f6-82673f3b4a9d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:45.142929 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7fb31c77-517c-41e3-857d-f4b6e2954a8b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:45.143845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7fb31c77-517c-41e3-857d-f4b6e2954a8b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:45.151716 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7fb31c77-517c-41e3-857d-f4b6e2954a8b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:45.152479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7fb31c77-517c-41e3-857d-f4b6e2954a8b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:45.153946 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7fb31c77-517c-41e3-857d-f4b6e2954a8b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:45.154544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7fb31c77-517c-41e3-857d-f4b6e2954a8b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:45.320636 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7fb31c77-517c-41e3-857d-f4b6e2954a8b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:45.320992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-36b20ee7-4aa6-4881-83f6-82673f3b4a9d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:45.328422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7fb31c77-517c-41e3-857d-f4b6e2954a8b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.194712 Jul 25 06:03:45.329005 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 358/721] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:45 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:45.329575 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-36b20ee7-4aa6-4881-83f6-82673f3b4a9d tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1723 microversion: 2.1 time: 0.216377 Jul 25 06:03:45.330340 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 364/722] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:45 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:45.779379 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0df1e2e8-c399-452f-89ea-52a5cdfcc6d0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:45.780140 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0df1e2e8-c399-452f-89ea-52a5cdfcc6d0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:45.786410 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0df1e2e8-c399-452f-89ea-52a5cdfcc6d0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:45.786859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0df1e2e8-c399-452f-89ea-52a5cdfcc6d0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:45.787708 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0df1e2e8-c399-452f-89ea-52a5cdfcc6d0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:45.788169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0df1e2e8-c399-452f-89ea-52a5cdfcc6d0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:45.995272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0df1e2e8-c399-452f-89ea-52a5cdfcc6d0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:46.003248 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0df1e2e8-c399-452f-89ea-52a5cdfcc6d0 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1513 microversion: 2.1 time: 0.228342 Jul 25 06:03:46.003825 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 359/723] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:45 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:46.074685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f54db7da-2e12-4daa-be8f-15b559fa50e9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:46.076018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f54db7da-2e12-4daa-be8f-15b559fa50e9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:46.082523 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f54db7da-2e12-4daa-be8f-15b559fa50e9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:46.082998 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f54db7da-2e12-4daa-be8f-15b559fa50e9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:46.083836 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f54db7da-2e12-4daa-be8f-15b559fa50e9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:46.084309 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f54db7da-2e12-4daa-be8f-15b559fa50e9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:46.327155 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f54db7da-2e12-4daa-be8f-15b559fa50e9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:46.336252 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f54db7da-2e12-4daa-be8f-15b559fa50e9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.265535 Jul 25 06:03:46.336838 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 365/724] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:46 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:46.346653 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9b465496-6ab6-438d-abca-657f9582a56a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:46.347261 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9b465496-6ab6-438d-abca-657f9582a56a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:46.347412 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-31822e81-fb52-4e7b-852c-25e9c963cb38 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:46.347985 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-31822e81-fb52-4e7b-852c-25e9c963cb38 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:46.353817 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b465496-6ab6-438d-abca-657f9582a56a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:46.354265 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b465496-6ab6-438d-abca-657f9582a56a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:46.354551 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-31822e81-fb52-4e7b-852c-25e9c963cb38 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:46.354910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-31822e81-fb52-4e7b-852c-25e9c963cb38 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:46.355029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b465496-6ab6-438d-abca-657f9582a56a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:46.355444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b465496-6ab6-438d-abca-657f9582a56a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:46.355681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-31822e81-fb52-4e7b-852c-25e9c963cb38 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:46.356642 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-31822e81-fb52-4e7b-852c-25e9c963cb38 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:46.503483 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-31822e81-fb52-4e7b-852c-25e9c963cb38 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:46.511955 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-31822e81-fb52-4e7b-852c-25e9c963cb38 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1358 microversion: 2.1 time: 0.168959 Jul 25 06:03:46.512699 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 360/725] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:46 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:46.553590 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9b465496-6ab6-438d-abca-657f9582a56a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:46.559112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-e4ca7f64-a1f9-4852-9ac7-1e92d9025f27 req-60cf0a84-20f1-4bcb-9b7a-2705a018bab7 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "33c564d4-6300-4c60-8829-01e8f445ce7a", "name": "network-vif-deleted", "tag": "38ff92c0-a00a-47e1-8c8a-767f34ecb3de"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:46.562538 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9b465496-6ab6-438d-abca-657f9582a56a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1723 microversion: 2.1 time: 0.219585 Jul 25 06:03:46.563111 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 366/726] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:46 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:46.567571 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-e4ca7f64-a1f9-4852-9ac7-1e92d9025f27 req-60cf0a84-20f1-4bcb-9b7a-2705a018bab7 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:46.568010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-e4ca7f64-a1f9-4852-9ac7-1e92d9025f27 req-60cf0a84-20f1-4bcb-9b7a-2705a018bab7 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:46.578636 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-e4ca7f64-a1f9-4852-9ac7-1e92d9025f27 req-60cf0a84-20f1-4bcb-9b7a-2705a018bab7 service nova] Creating event network-vif-deleted:38ff92c0-a00a-47e1-8c8a-767f34ecb3de for instance 33c564d4-6300-4c60-8829-01e8f445ce7a on hv-cinder-84841 Jul 25 06:03:46.583551 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-e4ca7f64-a1f9-4852-9ac7-1e92d9025f27 req-60cf0a84-20f1-4bcb-9b7a-2705a018bab7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028059 Jul 25 06:03:46.584167 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 361/727] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:47.021857 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-db146d2c-cd97-4d64-b35f-3df4ed7500e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:47.022479 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-db146d2c-cd97-4d64-b35f-3df4ed7500e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:47.030681 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db146d2c-cd97-4d64-b35f-3df4ed7500e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.031121 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db146d2c-cd97-4d64-b35f-3df4ed7500e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.032588 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db146d2c-cd97-4d64-b35f-3df4ed7500e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.033751 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db146d2c-cd97-4d64-b35f-3df4ed7500e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.124839 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-db146d2c-cd97-4d64-b35f-3df4ed7500e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:47.135859 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-db146d2c-cd97-4d64-b35f-3df4ed7500e8 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1303 microversion: 2.1 time: 0.117408 Jul 25 06:03:47.136487 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 367/728] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:47 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:47.354878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8aaebbfc-04b7-49c8-98ad-f9edaa6a0186 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:47.355607 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8aaebbfc-04b7-49c8-98ad-f9edaa6a0186 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:47.361988 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8aaebbfc-04b7-49c8-98ad-f9edaa6a0186 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.362462 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8aaebbfc-04b7-49c8-98ad-f9edaa6a0186 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.363250 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8aaebbfc-04b7-49c8-98ad-f9edaa6a0186 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.363689 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8aaebbfc-04b7-49c8-98ad-f9edaa6a0186 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.494005 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8aaebbfc-04b7-49c8-98ad-f9edaa6a0186 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:47.502012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8aaebbfc-04b7-49c8-98ad-f9edaa6a0186 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.152148 Jul 25 06:03:47.502579 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 362/729] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:47 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:47.528470 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-12e01da6-5c9d-425c-9484-cb00df511c4a tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:47.529082 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-12e01da6-5c9d-425c-9484-cb00df511c4a tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:47.535091 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-12e01da6-5c9d-425c-9484-cb00df511c4a tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.535474 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-12e01da6-5c9d-425c-9484-cb00df511c4a tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.536265 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-12e01da6-5c9d-425c-9484-cb00df511c4a tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.536701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-12e01da6-5c9d-425c-9484-cb00df511c4a tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.579494 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ce5a19c4-5e2d-450c-95d3-53425ff9c0ea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:47.580130 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ce5a19c4-5e2d-450c-95d3-53425ff9c0ea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:47.586058 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ce5a19c4-5e2d-450c-95d3-53425ff9c0ea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.586506 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ce5a19c4-5e2d-450c-95d3-53425ff9c0ea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.587266 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ce5a19c4-5e2d-450c-95d3-53425ff9c0ea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.587702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ce5a19c4-5e2d-450c-95d3-53425ff9c0ea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.666490 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-12e01da6-5c9d-425c-9484-cb00df511c4a tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:47.674340 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-12e01da6-5c9d-425c-9484-cb00df511c4a tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1547 microversion: 2.1 time: 0.149742 Jul 25 06:03:47.674915 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 368/730] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:47 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:47.690311 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-24a471f5-27ff-46a0-b464-2f03cf9d3a8e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:47.690908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-24a471f5-27ff-46a0-b464-2f03cf9d3a8e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:47.696819 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-24a471f5-27ff-46a0-b464-2f03cf9d3a8e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.697265 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-24a471f5-27ff-46a0-b464-2f03cf9d3a8e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.698021 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-24a471f5-27ff-46a0-b464-2f03cf9d3a8e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.698452 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-24a471f5-27ff-46a0-b464-2f03cf9d3a8e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.703060 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:47.720272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ce5a19c4-5e2d-450c-95d3-53425ff9c0ea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:47.728404 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ce5a19c4-5e2d-450c-95d3-53425ff9c0ea tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1723 microversion: 2.1 time: 0.153410 Jul 25 06:03:47.728983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 363/731] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:47 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:47.825915 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-24a471f5-27ff-46a0-b464-2f03cf9d3a8e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:47.833210 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-24a471f5-27ff-46a0-b464-2f03cf9d3a8e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1547 microversion: 2.1 time: 0.146542 Jul 25 06:03:47.833770 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 369/732] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:47 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:47.848513 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2f5fbf9f-77ea-415b-a47e-103a362ad05f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.index of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533fc9460>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:47.851935 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2f5fbf9f-77ea-415b-a47e-103a362ad05f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:47.852717 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2f5fbf9f-77ea-415b-a47e-103a362ad05f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Searching by: {'deleted': False, 'project_id': 'a18a468edefd401c835e7e368ac740e5'} {{(pid=124917) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 06:03:47.859976 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2f5fbf9f-77ea-415b-a47e-103a362ad05f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.860459 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2f5fbf9f-77ea-415b-a47e-103a362ad05f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.861276 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2f5fbf9f-77ea-415b-a47e-103a362ad05f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:47.861707 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2f5fbf9f-77ea-415b-a47e-103a362ad05f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:47.948687 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.multi_cell_list [None req-2f5fbf9f-77ea-415b-a47e-103a362ad05f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124917) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 06:03:48.043075 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2f5fbf9f-77ea-415b-a47e-103a362ad05f tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198184 Jul 25 06:03:48.043647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 364/733] 10.222.0.40 () {58 vars in 1124 bytes} [Mon Jul 25 06:03:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:48.054534 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d1f6b24f-3020-4c62-a476-f6afd68a1958 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:48.055145 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d1f6b24f-3020-4c62-a476-f6afd68a1958 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:48.061927 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d1f6b24f-3020-4c62-a476-f6afd68a1958 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:48.062369 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d1f6b24f-3020-4c62-a476-f6afd68a1958 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:48.063122 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d1f6b24f-3020-4c62-a476-f6afd68a1958 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:48.063557 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d1f6b24f-3020-4c62-a476-f6afd68a1958 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:48.152992 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7d2c5e00-fb8b-4ebf-9097-6398917c0afa tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:48.154356 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7d2c5e00-fb8b-4ebf-9097-6398917c0afa tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:48.160324 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7d2c5e00-fb8b-4ebf-9097-6398917c0afa tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:48.160773 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7d2c5e00-fb8b-4ebf-9097-6398917c0afa tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:48.161544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7d2c5e00-fb8b-4ebf-9097-6398917c0afa tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:48.161981 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7d2c5e00-fb8b-4ebf-9097-6398917c0afa tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:48.192923 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d1f6b24f-3020-4c62-a476-f6afd68a1958 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:48.193377 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7d2c5e00-fb8b-4ebf-9097-6398917c0afa tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:48.193826 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7d2c5e00-fb8b-4ebf-9097-6398917c0afa tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:48.194276 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-7d2c5e00-fb8b-4ebf-9097-6398917c0afa tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lazy-loading 'fault' on Instance uuid 33c564d4-6300-4c60-8829-01e8f445ce7a {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:48.201116 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d1f6b24f-3020-4c62-a476-f6afd68a1958 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1547 microversion: 2.1 time: 0.150391 Jul 25 06:03:48.201694 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 370/734] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:48 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:48.234784 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7d2c5e00-fb8b-4ebf-9097-6398917c0afa tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:48.242126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7d2c5e00-fb8b-4ebf-9097-6398917c0afa tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1308 microversion: 2.1 time: 0.092991 Jul 25 06:03:48.242689 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 365/735] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:48 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:48.520169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6a3f8fd1-6455-4589-ba57-394536f383b5 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:48.520792 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6a3f8fd1-6455-4589-ba57-394536f383b5 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:48.527027 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6a3f8fd1-6455-4589-ba57-394536f383b5 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:48.527462 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6a3f8fd1-6455-4589-ba57-394536f383b5 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:48.528959 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6a3f8fd1-6455-4589-ba57-394536f383b5 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:48.529706 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6a3f8fd1-6455-4589-ba57-394536f383b5 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:48.658929 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6a3f8fd1-6455-4589-ba57-394536f383b5 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:48.666339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6a3f8fd1-6455-4589-ba57-394536f383b5 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.150350 Jul 25 06:03:48.666893 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 371/736] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:48 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:48.746706 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f0db7498-d42b-42e8-9f96-c951158c1c0b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:48.747945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f0db7498-d42b-42e8-9f96-c951158c1c0b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:48.754838 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0db7498-d42b-42e8-9f96-c951158c1c0b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:48.755289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0db7498-d42b-42e8-9f96-c951158c1c0b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:48.756091 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0db7498-d42b-42e8-9f96-c951158c1c0b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:48.756550 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f0db7498-d42b-42e8-9f96-c951158c1c0b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:48.892772 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f0db7498-d42b-42e8-9f96-c951158c1c0b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:48.901335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f0db7498-d42b-42e8-9f96-c951158c1c0b tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1723 microversion: 2.1 time: 0.158619 Jul 25 06:03:48.901917 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 366/737] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:48 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:49.258638 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e5336116-61fd-40f7-906f-63176a9c348b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:49.259294 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e5336116-61fd-40f7-906f-63176a9c348b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:49.266553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5336116-61fd-40f7-906f-63176a9c348b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:49.266996 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5336116-61fd-40f7-906f-63176a9c348b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:49.267746 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5336116-61fd-40f7-906f-63176a9c348b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:49.268209 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5336116-61fd-40f7-906f-63176a9c348b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:49.299403 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5336116-61fd-40f7-906f-63176a9c348b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:49.299838 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5336116-61fd-40f7-906f-63176a9c348b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:49.300324 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-e5336116-61fd-40f7-906f-63176a9c348b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lazy-loading 'fault' on Instance uuid 33c564d4-6300-4c60-8829-01e8f445ce7a {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:49.344459 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-e5336116-61fd-40f7-906f-63176a9c348b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:49.351877 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e5336116-61fd-40f7-906f-63176a9c348b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1308 microversion: 2.1 time: 0.097064 Jul 25 06:03:49.352471 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 372/738] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:49 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:49.683078 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1a439264-ddec-4072-81b2-7c7f5ab5f6f6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:49.683689 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1a439264-ddec-4072-81b2-7c7f5ab5f6f6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:49.690225 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1a439264-ddec-4072-81b2-7c7f5ab5f6f6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:49.690663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1a439264-ddec-4072-81b2-7c7f5ab5f6f6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:49.691437 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1a439264-ddec-4072-81b2-7c7f5ab5f6f6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:49.691866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1a439264-ddec-4072-81b2-7c7f5ab5f6f6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:49.821432 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1a439264-ddec-4072-81b2-7c7f5ab5f6f6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:49.829702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1a439264-ddec-4072-81b2-7c7f5ab5f6f6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.150535 Jul 25 06:03:49.830253 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 367/739] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:49 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:49.919330 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5d92c533-9bf5-423c-a9ec-1adeb646cdd4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:49.920064 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5d92c533-9bf5-423c-a9ec-1adeb646cdd4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:49.931550 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d92c533-9bf5-423c-a9ec-1adeb646cdd4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:49.931995 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d92c533-9bf5-423c-a9ec-1adeb646cdd4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:49.932901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d92c533-9bf5-423c-a9ec-1adeb646cdd4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:49.936503 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d92c533-9bf5-423c-a9ec-1adeb646cdd4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:50.075280 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5d92c533-9bf5-423c-a9ec-1adeb646cdd4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:50.078210 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ec68b3ea-966d-4a86-b33d-228775474c47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f1c0>>, body: {"volumeAttachment": {"volumeId": "8bc82f01-3714-4a66-9651-bc7a87550a20"}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:50.079293 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ec68b3ea-966d-4a86-b33d-228775474c47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:50.083691 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5d92c533-9bf5-423c-a9ec-1adeb646cdd4 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1723 microversion: 2.1 time: 0.168844 Jul 25 06:03:50.084517 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 373/740] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:49 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:50.085343 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec68b3ea-966d-4a86-b33d-228775474c47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:50.085789 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec68b3ea-966d-4a86-b33d-228775474c47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:50.086560 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec68b3ea-966d-4a86-b33d-228775474c47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:50.087001 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec68b3ea-966d-4a86-b33d-228775474c47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:50.368530 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0d57b034-dd5b-4be4-ab96-2b6a9f22a7c2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:50.369134 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-0d57b034-dd5b-4be4-ab96-2b6a9f22a7c2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:50.376269 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0d57b034-dd5b-4be4-ab96-2b6a9f22a7c2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:50.376712 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0d57b034-dd5b-4be4-ab96-2b6a9f22a7c2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:50.377464 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0d57b034-dd5b-4be4-ab96-2b6a9f22a7c2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:50.377895 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0d57b034-dd5b-4be4-ab96-2b6a9f22a7c2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:50.408863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0d57b034-dd5b-4be4-ab96-2b6a9f22a7c2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:50.409310 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0d57b034-dd5b-4be4-ab96-2b6a9f22a7c2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:50.409744 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-0d57b034-dd5b-4be4-ab96-2b6a9f22a7c2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lazy-loading 'fault' on Instance uuid 33c564d4-6300-4c60-8829-01e8f445ce7a {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:03:50.454015 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-0d57b034-dd5b-4be4-ab96-2b6a9f22a7c2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5caf24262d214d9aa8cf9612582154f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d97f354896a4f1bbef0b4d1e6b99c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:50.462255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0d57b034-dd5b-4be4-ab96-2b6a9f22a7c2 tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 200 len: 1308 microversion: 2.1 time: 0.097550 Jul 25 06:03:50.463082 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 374/741] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:50 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:50.847045 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-da196118-b687-4bb6-b54f-8f519f3449ec tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:50.848100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-da196118-b687-4bb6-b54f-8f519f3449ec tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:50.854155 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-da196118-b687-4bb6-b54f-8f519f3449ec tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:50.859936 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-da196118-b687-4bb6-b54f-8f519f3449ec tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:50.859936 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-da196118-b687-4bb6-b54f-8f519f3449ec tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:50.859936 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-da196118-b687-4bb6-b54f-8f519f3449ec tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:50.991339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-da196118-b687-4bb6-b54f-8f519f3449ec tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:51.004494 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-da196118-b687-4bb6-b54f-8f519f3449ec tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.161281 Jul 25 06:03:51.005149 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 375/742] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:50 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:51.063613 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ec68b3ea-966d-4a86-b33d-228775474c47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "POST /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.989264 Jul 25 06:03:51.064676 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 368/743] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:03:50 2022] POST /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments => generated 194 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:51.102223 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-26fd099a-ee07-4bc8-8061-75f2808a11ac tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:51.103092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-26fd099a-ee07-4bc8-8061-75f2808a11ac tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:51.110040 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-26fd099a-ee07-4bc8-8061-75f2808a11ac tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:51.110547 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-26fd099a-ee07-4bc8-8061-75f2808a11ac tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:51.111391 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-26fd099a-ee07-4bc8-8061-75f2808a11ac tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:51.111920 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-26fd099a-ee07-4bc8-8061-75f2808a11ac tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:51.250165 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-26fd099a-ee07-4bc8-8061-75f2808a11ac tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:51.258791 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-26fd099a-ee07-4bc8-8061-75f2808a11ac tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1729 microversion: 2.1 time: 0.160876 Jul 25 06:03:51.259369 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 376/744] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:51 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:51.277289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c12b9298-b8fd-4fe8-956a-679ee017eb53 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method InterfaceAttachmentController.index of <nova.api.openstack.compute.attach_interfaces.InterfaceAttachmentController object at 0x7f6533e93e80>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:51.277950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c12b9298-b8fd-4fe8-956a-679ee017eb53 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:51.284923 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c12b9298-b8fd-4fe8-956a-679ee017eb53 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:51.285478 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c12b9298-b8fd-4fe8-956a-679ee017eb53 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:51.287060 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c12b9298-b8fd-4fe8-956a-679ee017eb53 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:51.287491 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c12b9298-b8fd-4fe8-956a-679ee017eb53 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:51.365970 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c12b9298-b8fd-4fe8-956a-679ee017eb53 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092812 Jul 25 06:03:51.369987 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 369/745] 10.222.0.40 () {58 vars in 1274 bytes} [Mon Jul 25 06:03:51 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:51.479441 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-018ce8d2-54c6-4f69-b885-2117f5f0ad7b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:51.480537 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-018ce8d2-54c6-4f69-b885-2117f5f0ad7b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] [instance: 33c564d4-6300-4c60-8829-01e8f445ce7a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:51.488222 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-018ce8d2-54c6-4f69-b885-2117f5f0ad7b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:51.488726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-018ce8d2-54c6-4f69-b885-2117f5f0ad7b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:51.494433 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-018ce8d2-54c6-4f69-b885-2117f5f0ad7b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:51.494433 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-018ce8d2-54c6-4f69-b885-2117f5f0ad7b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:51.509020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-018ce8d2-54c6-4f69-b885-2117f5f0ad7b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] HTTP exception thrown: Instance 33c564d4-6300-4c60-8829-01e8f445ce7a could not be found. Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-018ce8d2-54c6-4f69-b885-2117f5f0ad7b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Request method failure captured: Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a HTTP/1.1 Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jGZzVbEb49g81Ce7iPzr4bigt-YbPkWh0ieZMiTpt0w0bFcE5InohRlkd1OZuuSGNXTHW2cRPilRe4GuWcPv6x34vo3YDKydq4ApYHbgk31pFAMUP0KUA7_wNP1Men50HZNLsYS8u0unTj0QxscZzs-3chWHLn8uERBSZ-TqvNm3Kw Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: 7d97f354896a4f1bbef0b4d1e6b99c27 Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1573749398 Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:03:51.510747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/7d97f354896a4f1bbef0b4d1e6b99c27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d97f354896a4f1bbef0b4d1e6b99c27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_7d97f354896a4f1bbef0b4d1e6b99c27", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/7d97f354896a4f1bbef0b4d1e6b99c27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-VolumesSnapshotTestJSON-1573749398 Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: 7d97f354896a4f1bbef0b4d1e6b99c27 Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1573749398 Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-VolumesSnapshotTestJSON-1573749398-project Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 5caf24262d214d9aa8cf9612582154f5 Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-VolumesSnapshotTestJSON-1573749398-project Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance 33c564d4-6300-4c60-8829-01e8f445ce7a could not be found. Jul 25 06:03:51.512370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': '33c564d4-6300-4c60-8829-01e8f445ce7a'} Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33c564d4-6300-4c60-8829-01e8f445ce7a could not be found. Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:03:51.513708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33c564d4-6300-4c60-8829-01e8f445ce7a could not be found. Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33c564d4-6300-4c60-8829-01e8f445ce7a could not be found. Jul 25 06:03:51.516084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:03:51.526588 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-018ce8d2-54c6-4f69-b885-2117f5f0ad7b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] Returning 404 to user: Instance 33c564d4-6300-4c60-8829-01e8f445ce7a could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:03:51.526588 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-018ce8d2-54c6-4f69-b885-2117f5f0ad7b tempest-VolumesSnapshotTestJSON-1573749398 tempest-VolumesSnapshotTestJSON-1573749398-project] 10.222.0.40 "GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a" status: 404 len: 111 microversion: 2.1 time: 0.039652 Jul 25 06:03:51.526588 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 377/746] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:51 2022] GET /compute/v2.1/servers/33c564d4-6300-4c60-8829-01e8f445ce7a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:03:52.022222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2804cdfd-bd98-46e6-a633-ac292908821f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:52.022928 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2804cdfd-bd98-46e6-a633-ac292908821f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:52.030354 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2804cdfd-bd98-46e6-a633-ac292908821f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:52.030873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2804cdfd-bd98-46e6-a633-ac292908821f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:52.031702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2804cdfd-bd98-46e6-a633-ac292908821f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:52.032227 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2804cdfd-bd98-46e6-a633-ac292908821f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:52.036532 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:52.228441 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2804cdfd-bd98-46e6-a633-ac292908821f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:52.237481 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2804cdfd-bd98-46e6-a633-ac292908821f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.220087 Jul 25 06:03:52.238572 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 370/747] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:52 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:52.775671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-8e24cb6c-f639-4f98-b20c-e52e6ff66067 req-95cbb090-c5ab-4ad8-b263-0ff299f13877 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "e750488b-116b-4f02-a4bd-710c3867fa27", "tag": "f054b336-0d1e-4689-ae9f-d24089cd4d40"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:52.785697 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-8e24cb6c-f639-4f98-b20c-e52e6ff66067 req-95cbb090-c5ab-4ad8-b263-0ff299f13877 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:52.786144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-8e24cb6c-f639-4f98-b20c-e52e6ff66067 req-95cbb090-c5ab-4ad8-b263-0ff299f13877 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:52.797982 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-8e24cb6c-f639-4f98-b20c-e52e6ff66067 req-95cbb090-c5ab-4ad8-b263-0ff299f13877 service nova] Creating event network-changed:f054b336-0d1e-4689-ae9f-d24089cd4d40 for instance e750488b-116b-4f02-a4bd-710c3867fa27 on hv-cinder-84841 Jul 25 06:03:52.802957 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-8e24cb6c-f639-4f98-b20c-e52e6ff66067 req-95cbb090-c5ab-4ad8-b263-0ff299f13877 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032631 Jul 25 06:03:52.803581 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 378/748] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:53.201455 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-74e4b4be-db1b-42bf-bea8-b5d6290e5229 req-33d9e0d2-2d25-4a2d-bf7c-2bec227fa179 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "8fd12755-30ea-4aa4-94ce-e18ed9c29559", "name": "network-vif-plugged", "status": "completed", "tag": "6e112229-0732-4652-b953-cf6548e850ee"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:53.217873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-74e4b4be-db1b-42bf-bea8-b5d6290e5229 req-33d9e0d2-2d25-4a2d-bf7c-2bec227fa179 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:53.218338 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-74e4b4be-db1b-42bf-bea8-b5d6290e5229 req-33d9e0d2-2d25-4a2d-bf7c-2bec227fa179 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:53.234827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-74e4b4be-db1b-42bf-bea8-b5d6290e5229 req-33d9e0d2-2d25-4a2d-bf7c-2bec227fa179 service nova] Creating event network-vif-plugged:6e112229-0732-4652-b953-cf6548e850ee for instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 on hv-cinder-84841 Jul 25 06:03:53.240668 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-74e4b4be-db1b-42bf-bea8-b5d6290e5229 req-33d9e0d2-2d25-4a2d-bf7c-2bec227fa179 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043691 Jul 25 06:03:53.241262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 371/749] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:53.255683 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-892ce467-33f8-463d-aa48-ebbd786deb65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:53.259499 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-892ce467-33f8-463d-aa48-ebbd786deb65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:53.262997 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-892ce467-33f8-463d-aa48-ebbd786deb65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:53.263712 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-892ce467-33f8-463d-aa48-ebbd786deb65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:53.264738 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-892ce467-33f8-463d-aa48-ebbd786deb65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:53.265385 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-892ce467-33f8-463d-aa48-ebbd786deb65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:53.492604 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-892ce467-33f8-463d-aa48-ebbd786deb65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:53.501513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-892ce467-33f8-463d-aa48-ebbd786deb65 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.250060 Jul 25 06:03:53.502096 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 379/750] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:53 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:54.519560 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6e09bcb0-f7e1-4f5c-a4b2-0a2b5999675d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:54.520294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6e09bcb0-f7e1-4f5c-a4b2-0a2b5999675d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:54.526900 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e09bcb0-f7e1-4f5c-a4b2-0a2b5999675d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:54.527354 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e09bcb0-f7e1-4f5c-a4b2-0a2b5999675d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:54.528130 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e09bcb0-f7e1-4f5c-a4b2-0a2b5999675d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:54.528573 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e09bcb0-f7e1-4f5c-a4b2-0a2b5999675d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:54.660253 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6e09bcb0-f7e1-4f5c-a4b2-0a2b5999675d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:54.667588 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6e09bcb0-f7e1-4f5c-a4b2-0a2b5999675d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.153086 Jul 25 06:03:54.668162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 372/751] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:54 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:54.817904 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-64e8f1f8-3eb7-45ba-95d7-11e65265be89 req-b58a75b1-bc1d-47c6-a630-6e9f9271d1d5 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "e750488b-116b-4f02-a4bd-710c3867fa27", "tag": "f054b336-0d1e-4689-ae9f-d24089cd4d40"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:54.826352 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-64e8f1f8-3eb7-45ba-95d7-11e65265be89 req-b58a75b1-bc1d-47c6-a630-6e9f9271d1d5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:54.826672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-64e8f1f8-3eb7-45ba-95d7-11e65265be89 req-b58a75b1-bc1d-47c6-a630-6e9f9271d1d5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:54.837303 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-64e8f1f8-3eb7-45ba-95d7-11e65265be89 req-b58a75b1-bc1d-47c6-a630-6e9f9271d1d5 service nova] Creating event network-changed:f054b336-0d1e-4689-ae9f-d24089cd4d40 for instance e750488b-116b-4f02-a4bd-710c3867fa27 on hv-cinder-84841 Jul 25 06:03:54.842730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-64e8f1f8-3eb7-45ba-95d7-11e65265be89 req-b58a75b1-bc1d-47c6-a630-6e9f9271d1d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027700 Jul 25 06:03:54.843313 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 380/752] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:03:55.684728 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f8d7911a-6da3-4f15-b68f-4bbd37596cdc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:55.685867 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f8d7911a-6da3-4f15-b68f-4bbd37596cdc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:55.692425 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f8d7911a-6da3-4f15-b68f-4bbd37596cdc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:55.692873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f8d7911a-6da3-4f15-b68f-4bbd37596cdc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:55.693628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f8d7911a-6da3-4f15-b68f-4bbd37596cdc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:55.694062 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f8d7911a-6da3-4f15-b68f-4bbd37596cdc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:55.821699 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f8d7911a-6da3-4f15-b68f-4bbd37596cdc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:55.830257 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f8d7911a-6da3-4f15-b68f-4bbd37596cdc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.149358 Jul 25 06:03:55.830826 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 373/753] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:55 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:56.849422 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e5195f5a-a762-4b4c-ada1-687d6989120e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:56.850079 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e5195f5a-a762-4b4c-ada1-687d6989120e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:56.856360 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5195f5a-a762-4b4c-ada1-687d6989120e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:56.858806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5195f5a-a762-4b4c-ada1-687d6989120e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:56.858806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5195f5a-a762-4b4c-ada1-687d6989120e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:56.858806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e5195f5a-a762-4b4c-ada1-687d6989120e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:56.987928 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-e5195f5a-a762-4b4c-ada1-687d6989120e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:56.995318 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e5195f5a-a762-4b4c-ada1-687d6989120e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1366 microversion: 2.1 time: 0.150992 Jul 25 06:03:56.996367 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 381/754] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:56 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:03:58.012705 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f09971ca-4c07-4b0d-b994-1a5812ec71a9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:58.013243 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f09971ca-4c07-4b0d-b994-1a5812ec71a9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:58.015824 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:58.021872 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f09971ca-4c07-4b0d-b994-1a5812ec71a9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:58.023808 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f09971ca-4c07-4b0d-b994-1a5812ec71a9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:58.024923 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f09971ca-4c07-4b0d-b994-1a5812ec71a9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:58.025383 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f09971ca-4c07-4b0d-b994-1a5812ec71a9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:58.160290 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f09971ca-4c07-4b0d-b994-1a5812ec71a9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:58.168047 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f09971ca-4c07-4b0d-b994-1a5812ec71a9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1556 microversion: 2.1 time: 0.159607 Jul 25 06:03:58.169042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 374/755] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:58 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:03:58.185537 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9393f4fb-007b-458b-a14b-73018f5ba89b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method InterfaceAttachmentController.index of <nova.api.openstack.compute.attach_interfaces.InterfaceAttachmentController object at 0x7f6533f0dd90>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:58.186398 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9393f4fb-007b-458b-a14b-73018f5ba89b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:58.193028 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9393f4fb-007b-458b-a14b-73018f5ba89b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:58.193476 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9393f4fb-007b-458b-a14b-73018f5ba89b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:58.194269 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9393f4fb-007b-458b-a14b-73018f5ba89b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:58.194702 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9393f4fb-007b-458b-a14b-73018f5ba89b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:58.274367 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9393f4fb-007b-458b-a14b-73018f5ba89b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092812 Jul 25 06:03:58.275109 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 382/756] 10.222.0.40 () {58 vars in 1274 bytes} [Mon Jul 25 06:03:58 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:59.430261 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-c4761203-5a90-456c-972a-ea9227129194 req-08431c11-adfc-4ae4-baa2-a3930800ef7c service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "8fd12755-30ea-4aa4-94ce-e18ed9c29559", "tag": "6e112229-0732-4652-b953-cf6548e850ee"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:03:59.439643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-c4761203-5a90-456c-972a-ea9227129194 req-08431c11-adfc-4ae4-baa2-a3930800ef7c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:59.441434 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-c4761203-5a90-456c-972a-ea9227129194 req-08431c11-adfc-4ae4-baa2-a3930800ef7c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:59.451833 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-c4761203-5a90-456c-972a-ea9227129194 req-08431c11-adfc-4ae4-baa2-a3930800ef7c service nova] Creating event network-changed:6e112229-0732-4652-b953-cf6548e850ee for instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 on hv-cinder-84841 Jul 25 06:03:59.457114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-c4761203-5a90-456c-972a-ea9227129194 req-08431c11-adfc-4ae4-baa2-a3930800ef7c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030637 Jul 25 06:03:59.457954 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 375/757] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:03:59.718089 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-243f6ecb-b862-43ac-9368-efedc8941bf4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:03:59.718702 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-243f6ecb-b862-43ac-9368-efedc8941bf4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:03:59.724971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-243f6ecb-b862-43ac-9368-efedc8941bf4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:59.725425 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-243f6ecb-b862-43ac-9368-efedc8941bf4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:59.726185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-243f6ecb-b862-43ac-9368-efedc8941bf4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:03:59.726621 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-243f6ecb-b862-43ac-9368-efedc8941bf4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:03:59.908699 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-243f6ecb-b862-43ac-9368-efedc8941bf4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:03:59.917136 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-243f6ecb-b862-43ac-9368-efedc8941bf4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1593 microversion: 2.1 time: 0.203305 Jul 25 06:03:59.917826 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 383/758] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:03:59 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1593 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:02.097710 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-0f3816dc-2458-41db-b082-6d7fd11fe046 req-a7038455-a9ff-4d86-99a7-6c7f19989406 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "4c88e17a-19b8-4f75-bbe7-01c014030a3a", "tag": "279fa404-535f-4110-9863-de45be0f04f9"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:02.107075 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-0f3816dc-2458-41db-b082-6d7fd11fe046 req-a7038455-a9ff-4d86-99a7-6c7f19989406 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:02.111415 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-0f3816dc-2458-41db-b082-6d7fd11fe046 req-a7038455-a9ff-4d86-99a7-6c7f19989406 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:02.119668 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-0f3816dc-2458-41db-b082-6d7fd11fe046 req-a7038455-a9ff-4d86-99a7-6c7f19989406 service nova] Creating event network-changed:279fa404-535f-4110-9863-de45be0f04f9 for instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a on hv-cinder-84841 Jul 25 06:04:02.125735 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-0f3816dc-2458-41db-b082-6d7fd11fe046 req-a7038455-a9ff-4d86-99a7-6c7f19989406 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032015 Jul 25 06:04:02.126334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 376/759] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:04.617171 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ab1a2407-3caa-4393-bf74-598f6b3f69a7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Action: 'action', calling method: <bound method SecurityGroupActionController._addSecurityGroup of <nova.api.openstack.compute.security_groups.SecurityGroupActionController object at 0x7f6533f49520>>, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1993873638"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:04.617707 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ab1a2407-3caa-4393-bf74-598f6b3f69a7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:04.625031 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab1a2407-3caa-4393-bf74-598f6b3f69a7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:04.625478 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab1a2407-3caa-4393-bf74-598f6b3f69a7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:04.626245 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab1a2407-3caa-4393-bf74-598f6b3f69a7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:04.626681 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ab1a2407-3caa-4393-bf74-598f6b3f69a7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:04.753448 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.network.security_group_api [None req-ab1a2407-3caa-4393-bf74-598f6b3f69a7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Adding security group 675ab1fb-63b1-4425-be55-46d9266a0914 to port 279fa404-535f-4110-9863-de45be0f04f9 Jul 25 06:04:05.221521 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ab1a2407-3caa-4393-bf74-598f6b3f69a7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "POST /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.608074 Jul 25 06:04:05.222474 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 384/760] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:04:04 2022] POST /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:04:05.231575 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-250981a7-5c57-41a4-acfa-5dc790a834bc req-4b6d1cc7-6992-4cf8-b731-6f685c83f5d7 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "4c88e17a-19b8-4f75-bbe7-01c014030a3a", "tag": "279fa404-535f-4110-9863-de45be0f04f9"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:05.232976 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b9b57402-b3aa-4eb6-94b2-d6f2d4e9dc47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:05.233977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b9b57402-b3aa-4eb6-94b2-d6f2d4e9dc47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:05.243951 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9b57402-b3aa-4eb6-94b2-d6f2d4e9dc47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:05.244669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9b57402-b3aa-4eb6-94b2-d6f2d4e9dc47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:05.245175 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9b57402-b3aa-4eb6-94b2-d6f2d4e9dc47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:05.245605 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9b57402-b3aa-4eb6-94b2-d6f2d4e9dc47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:05.246859 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-250981a7-5c57-41a4-acfa-5dc790a834bc req-4b6d1cc7-6992-4cf8-b731-6f685c83f5d7 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:05.249545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-250981a7-5c57-41a4-acfa-5dc790a834bc req-4b6d1cc7-6992-4cf8-b731-6f685c83f5d7 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:05.263386 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-250981a7-5c57-41a4-acfa-5dc790a834bc req-4b6d1cc7-6992-4cf8-b731-6f685c83f5d7 service nova] Creating event network-changed:279fa404-535f-4110-9863-de45be0f04f9 for instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a on hv-cinder-84841 Jul 25 06:04:05.268696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-250981a7-5c57-41a4-acfa-5dc790a834bc req-4b6d1cc7-6992-4cf8-b731-6f685c83f5d7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040754 Jul 25 06:04:05.273960 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 385/761] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:05.403849 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b9b57402-b3aa-4eb6-94b2-d6f2d4e9dc47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:05.412010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b9b57402-b3aa-4eb6-94b2-d6f2d4e9dc47 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1758 microversion: 2.1 time: 0.184662 Jul 25 06:04:05.412602 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 377/762] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:05 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:06.179380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5741f2ff-7720-428f-a019-f237711e2be8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method VolumeAttachmentController.show of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ead730>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:06.179968 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5741f2ff-7720-428f-a019-f237711e2be8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:06.187508 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5741f2ff-7720-428f-a019-f237711e2be8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:06.188123 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5741f2ff-7720-428f-a019-f237711e2be8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:06.189007 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5741f2ff-7720-428f-a019-f237711e2be8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:06.189599 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5741f2ff-7720-428f-a019-f237711e2be8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:06.223808 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5741f2ff-7720-428f-a019-f237711e2be8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments/b8827126-a89f-4e58-b716-c8e077bb84c4" status: 200 len: 194 microversion: 2.20 time: 0.050256 Jul 25 06:04:06.229412 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 386/763] 10.222.0.40 () {60 vars in 1453 bytes} [Mon Jul 25 06:04:06 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments/b8827126-a89f-4e58-b716-c8e077bb84c4 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:04:06.295823 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6758df31-d8e8-4de4-87e5-e29aaae62cab tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4880>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:06.296350 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6758df31-d8e8-4de4-87e5-e29aaae62cab tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:06.303703 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6758df31-d8e8-4de4-87e5-e29aaae62cab tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:06.304363 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6758df31-d8e8-4de4-87e5-e29aaae62cab tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:06.305308 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6758df31-d8e8-4de4-87e5-e29aaae62cab tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:06.305925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6758df31-d8e8-4de4-87e5-e29aaae62cab tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:06.399507 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-6758df31-d8e8-4de4-87e5-e29aaae62cab tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lazy-loading 'services' on Instance uuid b2dc5c54-08fc-4392-a4b9-f1970578ffb7 {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:06.635003 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6758df31-d8e8-4de4-87e5-e29aaae62cab tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments/b8827126-a89f-4e58-b716-c8e077bb84c4" status: 202 len: 0 microversion: 2.20 time: 0.343959 Jul 25 06:04:06.635596 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 378/764] 10.222.0.40 () {60 vars in 1456 bytes} [Mon Jul 25 06:04:06 2022] DELETE /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments/b8827126-a89f-4e58-b716-c8e077bb84c4 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:04:06.644078 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-32ed7f16-f4cf-4898-876a-8d12ffa81834 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:06.645018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-32ed7f16-f4cf-4898-876a-8d12ffa81834 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:06.651411 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32ed7f16-f4cf-4898-876a-8d12ffa81834 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:06.651864 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32ed7f16-f4cf-4898-876a-8d12ffa81834 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:06.652669 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32ed7f16-f4cf-4898-876a-8d12ffa81834 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:06.653105 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32ed7f16-f4cf-4898-876a-8d12ffa81834 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:06.684213 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-32ed7f16-f4cf-4898-876a-8d12ffa81834 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044086 Jul 25 06:04:06.684783 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 387/765] 10.222.0.40 () {60 vars in 1342 bytes} [Mon Jul 25 06:04:06 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:04:07.697136 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0418dca7-dfae-4318-b7c2-ae320fb278f9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:07.698202 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0418dca7-dfae-4318-b7c2-ae320fb278f9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:07.705479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0418dca7-dfae-4318-b7c2-ae320fb278f9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:07.705975 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0418dca7-dfae-4318-b7c2-ae320fb278f9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:07.706721 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0418dca7-dfae-4318-b7c2-ae320fb278f9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:07.707152 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0418dca7-dfae-4318-b7c2-ae320fb278f9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:07.736249 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0418dca7-dfae-4318-b7c2-ae320fb278f9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043838 Jul 25 06:04:07.736802 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 379/766] 10.222.0.40 () {60 vars in 1342 bytes} [Mon Jul 25 06:04:07 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:04:08.747092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7b6c934f-ef64-4815-b880-7a98a63de6ff tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:08.748604 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7b6c934f-ef64-4815-b880-7a98a63de6ff tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:08.755085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b6c934f-ef64-4815-b880-7a98a63de6ff tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:08.755528 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b6c934f-ef64-4815-b880-7a98a63de6ff tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:08.756320 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b6c934f-ef64-4815-b880-7a98a63de6ff tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:08.756757 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b6c934f-ef64-4815-b880-7a98a63de6ff tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:08.773822 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=100 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:08.786301 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7b6c934f-ef64-4815-b880-7a98a63de6ff tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043275 Jul 25 06:04:08.786863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 388/767] 10.222.0.40 () {60 vars in 1342 bytes} [Mon Jul 25 06:04:08 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:08.850431 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-cbfde0ed-becf-416d-a301-189e88917e79 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:08.851061 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cbfde0ed-becf-416d-a301-189e88917e79 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:08.858227 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cbfde0ed-becf-416d-a301-189e88917e79 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:08.858672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cbfde0ed-becf-416d-a301-189e88917e79 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:08.859413 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cbfde0ed-becf-416d-a301-189e88917e79 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:08.859842 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cbfde0ed-becf-416d-a301-189e88917e79 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:08.884980 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cbfde0ed-becf-416d-a301-189e88917e79 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Going to try to terminate instance {{(pid=124917) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:04:09.184921 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-cbfde0ed-becf-416d-a301-189e88917e79 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 204 len: 0 microversion: 2.20 time: 0.338096 Jul 25 06:04:09.186196 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 380/768] 10.222.0.40 () {60 vars in 1279 bytes} [Mon Jul 25 06:04:08 2022] DELETE /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 06:04:09.195271 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-56bf14da-01c5-468f-b98f-e005a535e5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:09.195883 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-56bf14da-01c5-468f-b98f-e005a535e5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:09.202916 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-56bf14da-01c5-468f-b98f-e005a535e5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:09.203361 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-56bf14da-01c5-468f-b98f-e005a535e5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:09.204131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-56bf14da-01c5-468f-b98f-e005a535e5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:09.204571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-56bf14da-01c5-468f-b98f-e005a535e5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:09.334156 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-56bf14da-01c5-468f-b98f-e005a535e5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:09.342636 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-56bf14da-01c5-468f-b98f-e005a535e5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:09.344160 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-56bf14da-01c5-468f-b98f-e005a535e5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:09.345309 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-56bf14da-01c5-468f-b98f-e005a535e5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.154391 Jul 25 06:04:09.345866 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 389/769] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:09 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:04:10.363821 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3acce4b6-d007-4626-9e15-67bd8423d509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:10.364480 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3acce4b6-d007-4626-9e15-67bd8423d509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:10.370983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3acce4b6-d007-4626-9e15-67bd8423d509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:10.371435 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3acce4b6-d007-4626-9e15-67bd8423d509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:10.372229 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3acce4b6-d007-4626-9e15-67bd8423d509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:10.372668 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3acce4b6-d007-4626-9e15-67bd8423d509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:10.500474 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3acce4b6-d007-4626-9e15-67bd8423d509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:10.508295 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3acce4b6-d007-4626-9e15-67bd8423d509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:10.509844 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3acce4b6-d007-4626-9e15-67bd8423d509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:10.510991 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3acce4b6-d007-4626-9e15-67bd8423d509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.151577 Jul 25 06:04:10.511549 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 381/770] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:10 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:11.530250 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-135aff8e-fefb-4578-a74d-cb8935573b3d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:11.531006 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-135aff8e-fefb-4578-a74d-cb8935573b3d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:11.537747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-135aff8e-fefb-4578-a74d-cb8935573b3d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:11.538197 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-135aff8e-fefb-4578-a74d-cb8935573b3d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:11.538972 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-135aff8e-fefb-4578-a74d-cb8935573b3d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:11.539411 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-135aff8e-fefb-4578-a74d-cb8935573b3d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:11.791384 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-135aff8e-fefb-4578-a74d-cb8935573b3d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:11.799857 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-135aff8e-fefb-4578-a74d-cb8935573b3d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:11.801383 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-135aff8e-fefb-4578-a74d-cb8935573b3d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:11.802524 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-135aff8e-fefb-4578-a74d-cb8935573b3d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1721 microversion: 2.20 time: 0.276970 Jul 25 06:04:11.803079 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 390/771] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:11 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:04:12.305543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-2825de82-00a4-4448-9adb-c411be3d83dc req-7549e49a-3f21-4069-b946-e9e16617417d service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "b2dc5c54-08fc-4392-a4b9-f1970578ffb7", "name": "network-vif-deleted", "tag": "c86fe1cd-ba90-483f-8c21-3093b1ee753e"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:12.311241 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-2825de82-00a4-4448-9adb-c411be3d83dc req-7549e49a-3f21-4069-b946-e9e16617417d service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:12.311931 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-2825de82-00a4-4448-9adb-c411be3d83dc req-7549e49a-3f21-4069-b946-e9e16617417d service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:12.323189 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-2825de82-00a4-4448-9adb-c411be3d83dc req-7549e49a-3f21-4069-b946-e9e16617417d service nova] Creating event network-vif-deleted:c86fe1cd-ba90-483f-8c21-3093b1ee753e for instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 on hv-cinder-84841 Jul 25 06:04:12.328716 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-2825de82-00a4-4448-9adb-c411be3d83dc req-7549e49a-3f21-4069-b946-e9e16617417d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031212 Jul 25 06:04:12.329337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 382/772] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:12.821660 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:12.822421 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:12.829451 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:12.829902 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:12.830666 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:12.831099 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:12.862642 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:12.863154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:12.863541 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lazy-loading 'fault' on Instance uuid b2dc5c54-08fc-4392-a4b9-f1970578ffb7 {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:12.910299 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:12.918455 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:12.919982 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:12.921254 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-301803f8-d6ca-416a-ac1d-f417686ed71a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 200 len: 1370 microversion: 2.20 time: 0.103682 Jul 25 06:04:12.921811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 391/773] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:12 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:13.943174 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7a5ea52f-19dc-47e5-bfba-7dd57c016824 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:13.943923 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7a5ea52f-19dc-47e5-bfba-7dd57c016824 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:13.950573 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7a5ea52f-19dc-47e5-bfba-7dd57c016824 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:13.951012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7a5ea52f-19dc-47e5-bfba-7dd57c016824 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:13.951756 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7a5ea52f-19dc-47e5-bfba-7dd57c016824 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:13.952213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7a5ea52f-19dc-47e5-bfba-7dd57c016824 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:13.965285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-7a5ea52f-19dc-47e5-bfba-7dd57c016824 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] HTTP exception thrown: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7a5ea52f-19dc-47e5-bfba-7dd57c016824 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Request method failure captured: Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 HTTP/1.1 Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFMsd7VnC2kr70aIzPrFdLMYtenFSQtqdHvqO-np3XX20Ut6YTFTsAznFB7C5DysmkzZhBhWb56f_stDheLeg0EaJUm8yyhdkZYgJATZ1W1ZlEx7qSzy1FVmz9YpeWZEzRFCIv0xXCbsoIZVHaRmVSo38CPWkF9zU2yQhev4nDC1Tk Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:04:13.970534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1871c9af781743f5af1d92371a42ecf1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: d485f9fc38a442dd9e1528024460fcca Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:04:13.972316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'b2dc5c54-08fc-4392-a4b9-f1970578ffb7'} Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:04:13.973117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:04:13.974332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:13.975414 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7a5ea52f-19dc-47e5-bfba-7dd57c016824 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Returning 404 to user: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:04:13.975414 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7a5ea52f-19dc-47e5-bfba-7dd57c016824 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 404 len: 111 microversion: 2.20 time: 0.029676 Jul 25 06:04:13.975414 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 383/774] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:13 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:04:13.977653 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-70b3cc51-1dfd-4f12-a20e-8586cc7f787c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531d19c10>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:14.040204 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-70b3cc51-1dfd-4f12-a20e-8586cc7f787c tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597729569" status: 204 len: 0 microversion: 2.20 time: 0.066218 Jul 25 06:04:14.040781 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 392/775] 10.222.0.40 () {60 vars in 1258 bytes} [Mon Jul 25 06:04:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597729569 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 06:04:14.814614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0d01baee-1d3a-435a-ab8e-756fe7534592 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6531b86790>, body: {"keypair": {"name": "tempest-keypair-882577647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUkLm4KHGrG6MD4frC/yBuX0OCquBz20ASSB24k9TQb2BFL3Km3QOgnlW5L4kBXVncJe8AjGxVfG+AdKsj2xGpQbFkxOMoHai3QC+VybRAmH9wwRXrcI/ySF1K27IyCgw=="}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:14.820847 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:14.830486 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-0d01baee-1d3a-435a-ab8e-756fe7534592 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Getting quotas for project 1871c9af781743f5af1d92371a42ecf1. Resources: {'key_pairs'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:04:14.837946 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-0d01baee-1d3a-435a-ab8e-756fe7534592 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Getting quotas for user d485f9fc38a442dd9e1528024460fcca and project 1871c9af781743f5af1d92371a42ecf1. Resources: {'key_pairs'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:04:14.926402 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0d01baee-1d3a-435a-ab8e-756fe7534592 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.116662 Jul 25 06:04:14.927289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 384/776] 10.222.0.40 () {62 vars in 1199 bytes} [Mon Jul 25 06:04:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 06:04:17.238633 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5c4c0>>, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1838493883", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d09a72ec-f4c1-4494-ae4f-e65cd0316aed"}], "security_groups": [{"name": "tempest-securitygroup--652363286"}], "key_name": "tempest-keypair-882577647", "user_data": "}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:17.245573 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:17.345620 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.network.neutron [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] validate_networks() for [('d09a72ec-f4c1-4494-ae4f-e65cd0316aed', None, None, None, None, None)] {{(pid=124918) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:04:18.113842 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Flavor limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:04:18.114269 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Image limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:04:18.114728 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Flavor pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:04:18.115131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Image pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:04:18.115538 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:04:18.124456 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:18.125402 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:18.126195 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:18.126628 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:18.144339 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Getting quotas for project 1871c9af781743f5af1d92371a42ecf1. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:04:18.148700 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Getting quotas for user d485f9fc38a442dd9e1528024460fcca and project 1871c9af781743f5af1d92371a42ecf1. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:04:18.160206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Going to run 1 instances... {{(pid=124918) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:04:18.162596 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:04:18.273438 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-021f1eae-3162-467f-8469-3e1560fe9df0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.040671 Jul 25 06:04:18.274093 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 393/777] 10.222.0.40 () {62 vars in 1187 bytes} [Mon Jul 25 06:04:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 06:04:18.285632 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0e5f5f8a-88bb-4c0b-bf15-a4ce40a0ef7f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:18.286242 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0e5f5f8a-88bb-4c0b-bf15-a4ce40a0ef7f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:18.354665 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0e5f5f8a-88bb-4c0b-bf15-a4ce40a0ef7f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:18.363869 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0e5f5f8a-88bb-4c0b-bf15-a4ce40a0ef7f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:18.366268 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0e5f5f8a-88bb-4c0b-bf15-a4ce40a0ef7f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:18.367514 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0e5f5f8a-88bb-4c0b-bf15-a4ce40a0ef7f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1281 microversion: 2.20 time: 0.087210 Jul 25 06:04:18.368818 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 385/778] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:18 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1281 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:19.387440 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-91ae941f-ff46-4246-bf38-5cbfbd879f66 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:19.388097 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-91ae941f-ff46-4246-bf38-5cbfbd879f66 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:19.394373 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-91ae941f-ff46-4246-bf38-5cbfbd879f66 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:19.394811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-91ae941f-ff46-4246-bf38-5cbfbd879f66 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:19.395571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-91ae941f-ff46-4246-bf38-5cbfbd879f66 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:19.395997 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-91ae941f-ff46-4246-bf38-5cbfbd879f66 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:19.460533 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-91ae941f-ff46-4246-bf38-5cbfbd879f66 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:19.468733 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-91ae941f-ff46-4246-bf38-5cbfbd879f66 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:19.470230 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-91ae941f-ff46-4246-bf38-5cbfbd879f66 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:19.471402 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-91ae941f-ff46-4246-bf38-5cbfbd879f66 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1285 microversion: 2.20 time: 0.088454 Jul 25 06:04:19.471953 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 394/779] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:19 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:19.594126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-02ab2d5a-00fb-4e9d-9d62-197ad8dd11da tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:19.595098 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-02ab2d5a-00fb-4e9d-9d62-197ad8dd11da tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:19.601712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02ab2d5a-00fb-4e9d-9d62-197ad8dd11da tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:19.602896 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02ab2d5a-00fb-4e9d-9d62-197ad8dd11da tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:19.602999 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02ab2d5a-00fb-4e9d-9d62-197ad8dd11da tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:19.603365 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-02ab2d5a-00fb-4e9d-9d62-197ad8dd11da tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:19.633818 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-02ab2d5a-00fb-4e9d-9d62-197ad8dd11da tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044899 Jul 25 06:04:19.634394 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 386/780] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:19 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:04:19.701736 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4e7a3be4-1335-4ee2-b664-28e37722ae4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:19.702180 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4e7a3be4-1335-4ee2-b664-28e37722ae4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:19.709191 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4e7a3be4-1335-4ee2-b664-28e37722ae4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:19.709649 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4e7a3be4-1335-4ee2-b664-28e37722ae4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:19.710432 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4e7a3be4-1335-4ee2-b664-28e37722ae4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:19.710889 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4e7a3be4-1335-4ee2-b664-28e37722ae4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:19.739191 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4e7a3be4-1335-4ee2-b664-28e37722ae4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:04:20.076467 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4e7a3be4-1335-4ee2-b664-28e37722ae4c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 204 len: 0 microversion: 2.1 time: 0.378279 Jul 25 06:04:20.077061 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 395/781] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:04:19 2022] DELETE /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:04:20.086408 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6de8394f-52b4-4c4d-a08a-ccf32c577ef8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:20.087428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6de8394f-52b4-4c4d-a08a-ccf32c577ef8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:20.094148 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6de8394f-52b4-4c4d-a08a-ccf32c577ef8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:20.094585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6de8394f-52b4-4c4d-a08a-ccf32c577ef8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:20.095336 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6de8394f-52b4-4c4d-a08a-ccf32c577ef8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:20.095765 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6de8394f-52b4-4c4d-a08a-ccf32c577ef8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:20.233113 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6de8394f-52b4-4c4d-a08a-ccf32c577ef8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:20.246843 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6de8394f-52b4-4c4d-a08a-ccf32c577ef8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1674 microversion: 2.1 time: 0.165176 Jul 25 06:04:20.247420 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 387/782] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:20 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:20.493044 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-69d0e1f1-28d3-418e-b4c8-f2141cf80897 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:20.493763 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-69d0e1f1-28d3-418e-b4c8-f2141cf80897 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:20.500415 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-69d0e1f1-28d3-418e-b4c8-f2141cf80897 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:20.500860 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-69d0e1f1-28d3-418e-b4c8-f2141cf80897 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:20.501617 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-69d0e1f1-28d3-418e-b4c8-f2141cf80897 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:20.502049 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-69d0e1f1-28d3-418e-b4c8-f2141cf80897 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:20.565818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-69d0e1f1-28d3-418e-b4c8-f2141cf80897 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:20.573842 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-69d0e1f1-28d3-418e-b4c8-f2141cf80897 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:20.575366 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-69d0e1f1-28d3-418e-b4c8-f2141cf80897 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:20.576519 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-69d0e1f1-28d3-418e-b4c8-f2141cf80897 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1341 microversion: 2.20 time: 0.087682 Jul 25 06:04:20.577078 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 396/783] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:20 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1341 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:21.267692 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-01775b94-1775-4114-88e7-caaf8b139cf5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:21.268256 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-01775b94-1775-4114-88e7-caaf8b139cf5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:21.275112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01775b94-1775-4114-88e7-caaf8b139cf5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:21.275552 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01775b94-1775-4114-88e7-caaf8b139cf5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:21.276343 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01775b94-1775-4114-88e7-caaf8b139cf5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:21.276772 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01775b94-1775-4114-88e7-caaf8b139cf5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:21.405986 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-01775b94-1775-4114-88e7-caaf8b139cf5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:21.413513 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-01775b94-1775-4114-88e7-caaf8b139cf5 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1674 microversion: 2.1 time: 0.151045 Jul 25 06:04:21.414077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 388/784] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:21 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:21.594245 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2f9c9052-2d4e-4847-8a0e-3a19ff1c8394 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:21.594780 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2f9c9052-2d4e-4847-8a0e-3a19ff1c8394 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:21.601378 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f9c9052-2d4e-4847-8a0e-3a19ff1c8394 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:21.601870 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f9c9052-2d4e-4847-8a0e-3a19ff1c8394 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:21.602634 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f9c9052-2d4e-4847-8a0e-3a19ff1c8394 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:21.603067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2f9c9052-2d4e-4847-8a0e-3a19ff1c8394 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:21.663937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2f9c9052-2d4e-4847-8a0e-3a19ff1c8394 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:21.672590 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2f9c9052-2d4e-4847-8a0e-3a19ff1c8394 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:21.674097 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2f9c9052-2d4e-4847-8a0e-3a19ff1c8394 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:21.675184 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2f9c9052-2d4e-4847-8a0e-3a19ff1c8394 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1341 microversion: 2.20 time: 0.084990 Jul 25 06:04:21.675740 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 397/785] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:21 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1341 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:22.431232 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-603a214e-4c6a-4935-a45e-37952cb40e9b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:22.431839 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-603a214e-4c6a-4935-a45e-37952cb40e9b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:22.439206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-603a214e-4c6a-4935-a45e-37952cb40e9b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:22.439648 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-603a214e-4c6a-4935-a45e-37952cb40e9b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:22.440424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-603a214e-4c6a-4935-a45e-37952cb40e9b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:22.440860 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-603a214e-4c6a-4935-a45e-37952cb40e9b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:22.598160 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-603a214e-4c6a-4935-a45e-37952cb40e9b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:22.601641 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:22.607312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-603a214e-4c6a-4935-a45e-37952cb40e9b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1674 microversion: 2.1 time: 0.179935 Jul 25 06:04:22.608169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 389/786] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:22 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:22.693501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9baf0005-48ba-4972-a716-4706c63a7ce2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:22.694108 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9baf0005-48ba-4972-a716-4706c63a7ce2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:22.700693 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9baf0005-48ba-4972-a716-4706c63a7ce2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:22.701138 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9baf0005-48ba-4972-a716-4706c63a7ce2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:22.701897 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9baf0005-48ba-4972-a716-4706c63a7ce2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:22.702330 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9baf0005-48ba-4972-a716-4706c63a7ce2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:23.012708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9baf0005-48ba-4972-a716-4706c63a7ce2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:23.021842 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9baf0005-48ba-4972-a716-4706c63a7ce2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:23.023753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9baf0005-48ba-4972-a716-4706c63a7ce2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:23.025085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9baf0005-48ba-4972-a716-4706c63a7ce2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1351 microversion: 2.20 time: 0.335561 Jul 25 06:04:23.025648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 398/787] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:22 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1351 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:23.604623 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-08373692-f6ea-4cbe-b1ed-35078ccc8374 req-07137240-7516-444c-ba46-007c7cab68dc service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "a502c8d3-07ac-4e7f-9127-1281c94c5724", "name": "network-vif-deleted", "tag": "a7211a3e-e5a1-4df6-b97c-4d903ce963ca"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:23.613910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-08373692-f6ea-4cbe-b1ed-35078ccc8374 req-07137240-7516-444c-ba46-007c7cab68dc service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:23.614351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-08373692-f6ea-4cbe-b1ed-35078ccc8374 req-07137240-7516-444c-ba46-007c7cab68dc service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:23.626266 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-08373692-f6ea-4cbe-b1ed-35078ccc8374 req-07137240-7516-444c-ba46-007c7cab68dc service nova] Creating event network-vif-deleted:a7211a3e-e5a1-4df6-b97c-4d903ce963ca for instance a502c8d3-07ac-4e7f-9127-1281c94c5724 on hv-cinder-84841 Jul 25 06:04:23.626935 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1ab8f892-905d-488f-af24-a746195266fb tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:23.627680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1ab8f892-905d-488f-af24-a746195266fb tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:23.631598 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-08373692-f6ea-4cbe-b1ed-35078ccc8374 req-07137240-7516-444c-ba46-007c7cab68dc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030947 Jul 25 06:04:23.632390 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 390/788] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:23.634734 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1ab8f892-905d-488f-af24-a746195266fb tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:23.635520 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1ab8f892-905d-488f-af24-a746195266fb tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:23.636379 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1ab8f892-905d-488f-af24-a746195266fb tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:23.636885 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1ab8f892-905d-488f-af24-a746195266fb tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:23.705127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1ab8f892-905d-488f-af24-a746195266fb tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:23.713975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1ab8f892-905d-488f-af24-a746195266fb tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1606 microversion: 2.1 time: 0.091944 Jul 25 06:04:23.716216 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 399/789] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:23 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1606 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:24.046683 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8473429d-9c36-4c9b-a3d1-01e12d0cdc7e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:24.047542 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8473429d-9c36-4c9b-a3d1-01e12d0cdc7e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:24.054621 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8473429d-9c36-4c9b-a3d1-01e12d0cdc7e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:24.055072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8473429d-9c36-4c9b-a3d1-01e12d0cdc7e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:24.055835 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8473429d-9c36-4c9b-a3d1-01e12d0cdc7e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:24.056309 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8473429d-9c36-4c9b-a3d1-01e12d0cdc7e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:24.243944 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8473429d-9c36-4c9b-a3d1-01e12d0cdc7e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:24.252605 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8473429d-9c36-4c9b-a3d1-01e12d0cdc7e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:24.254240 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8473429d-9c36-4c9b-a3d1-01e12d0cdc7e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:24.255431 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8473429d-9c36-4c9b-a3d1-01e12d0cdc7e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1406 microversion: 2.20 time: 0.213114 Jul 25 06:04:24.256070 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 391/790] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:24 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:24.732529 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c4da1325-4c3a-44e9-b5d7-f2712f876e8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:24.733241 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c4da1325-4c3a-44e9-b5d7-f2712f876e8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:24.741102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c4da1325-4c3a-44e9-b5d7-f2712f876e8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:24.746546 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c4da1325-4c3a-44e9-b5d7-f2712f876e8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:24.746546 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c4da1325-4c3a-44e9-b5d7-f2712f876e8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:24.746546 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c4da1325-4c3a-44e9-b5d7-f2712f876e8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:24.809119 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c4da1325-4c3a-44e9-b5d7-f2712f876e8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:24.816908 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c4da1325-4c3a-44e9-b5d7-f2712f876e8a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1606 microversion: 2.1 time: 0.088561 Jul 25 06:04:24.817468 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 400/791] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:24 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:25.274655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d475ec8c-9e80-4247-85f2-f9e8795f8e8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:25.275284 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d475ec8c-9e80-4247-85f2-f9e8795f8e8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:25.282522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d475ec8c-9e80-4247-85f2-f9e8795f8e8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:25.282968 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d475ec8c-9e80-4247-85f2-f9e8795f8e8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:25.283748 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d475ec8c-9e80-4247-85f2-f9e8795f8e8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:25.284218 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d475ec8c-9e80-4247-85f2-f9e8795f8e8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:25.412610 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d475ec8c-9e80-4247-85f2-f9e8795f8e8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:25.420431 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d475ec8c-9e80-4247-85f2-f9e8795f8e8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:25.422452 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d475ec8c-9e80-4247-85f2-f9e8795f8e8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:25.423548 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d475ec8c-9e80-4247-85f2-f9e8795f8e8b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1406 microversion: 2.20 time: 0.153149 Jul 25 06:04:25.424130 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 392/792] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:25 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:25.834433 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b6e947b7-9833-4d5a-a930-1e764e9f4678 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:25.835215 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b6e947b7-9833-4d5a-a930-1e764e9f4678 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:25.841569 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b6e947b7-9833-4d5a-a930-1e764e9f4678 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:25.842019 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b6e947b7-9833-4d5a-a930-1e764e9f4678 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:25.842783 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b6e947b7-9833-4d5a-a930-1e764e9f4678 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:25.843218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b6e947b7-9833-4d5a-a930-1e764e9f4678 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:25.876623 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b6e947b7-9833-4d5a-a930-1e764e9f4678 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:25.877068 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b6e947b7-9833-4d5a-a930-1e764e9f4678 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:25.877508 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-b6e947b7-9833-4d5a-a930-1e764e9f4678 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lazy-loading 'fault' on Instance uuid a502c8d3-07ac-4e7f-9127-1281c94c5724 {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:25.918351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b6e947b7-9833-4d5a-a930-1e764e9f4678 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:25.926677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b6e947b7-9833-4d5a-a930-1e764e9f4678 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 200 len: 1326 microversion: 2.1 time: 0.096181 Jul 25 06:04:25.928927 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 401/793] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:25 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:26.291231 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-f9463129-16b8-4edd-b3c0-77558ed3df95 req-cb6e4bbe-a7b5-4ee8-87a8-439bc425118c service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "5e834f53-fb25-48ed-a03c-33717c1e39ff", "tag": "ca3ad013-ac59-49fd-a355-d63dbc1c3385"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:26.303836 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-f9463129-16b8-4edd-b3c0-77558ed3df95 req-cb6e4bbe-a7b5-4ee8-87a8-439bc425118c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:26.306068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-f9463129-16b8-4edd-b3c0-77558ed3df95 req-cb6e4bbe-a7b5-4ee8-87a8-439bc425118c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:26.319510 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-f9463129-16b8-4edd-b3c0-77558ed3df95 req-cb6e4bbe-a7b5-4ee8-87a8-439bc425118c service nova] Creating event network-changed:ca3ad013-ac59-49fd-a355-d63dbc1c3385 for instance 5e834f53-fb25-48ed-a03c-33717c1e39ff on hv-cinder-84841 Jul 25 06:04:26.324274 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-f9463129-16b8-4edd-b3c0-77558ed3df95 req-cb6e4bbe-a7b5-4ee8-87a8-439bc425118c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036814 Jul 25 06:04:26.324877 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 393/794] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:26.443098 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5d29477a-d82b-4de0-84c5-987162e6c699 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:26.444499 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5d29477a-d82b-4de0-84c5-987162e6c699 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:26.451217 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d29477a-d82b-4de0-84c5-987162e6c699 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:26.451949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d29477a-d82b-4de0-84c5-987162e6c699 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:26.453739 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d29477a-d82b-4de0-84c5-987162e6c699 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:26.454733 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5d29477a-d82b-4de0-84c5-987162e6c699 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:26.666055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5d29477a-d82b-4de0-84c5-987162e6c699 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:26.678086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5d29477a-d82b-4de0-84c5-987162e6c699 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:26.679598 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5d29477a-d82b-4de0-84c5-987162e6c699 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:26.680776 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5d29477a-d82b-4de0-84c5-987162e6c699 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1406 microversion: 2.20 time: 0.242354 Jul 25 06:04:26.681337 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 402/795] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:26 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:26.944559 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1b31123d-993f-4ed3-9641-7aa481a81ba9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:26.945658 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1b31123d-993f-4ed3-9641-7aa481a81ba9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:26.952324 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1b31123d-993f-4ed3-9641-7aa481a81ba9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:26.952768 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1b31123d-993f-4ed3-9641-7aa481a81ba9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:26.953577 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1b31123d-993f-4ed3-9641-7aa481a81ba9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:26.954111 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1b31123d-993f-4ed3-9641-7aa481a81ba9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:26.967875 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-1b31123d-993f-4ed3-9641-7aa481a81ba9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] HTTP exception thrown: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1b31123d-993f-4ed3-9641-7aa481a81ba9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Request method failure captured: Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 HTTP/1.1 Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFFALlSjL-DgY5moCP7nmzz8131ed284hmG-PhVhDrwSHOswsRSoAQ8xXOVKdEeyvoJVsaYFzqoBCtDHumnfGUSB_RDXQDDrCzgWhrHSDzW_WFNdG3OiaTphFoyolEhOtNL3g628FVyFxYe0Hw2JJm0Xkmw24aaepW707BgON7P9Ew Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:04:26.969797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ea60662f93343019fe380b6e13d5d18", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: a7224418acee432182bf3195bfc8fd99 Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:04:26.971335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'a502c8d3-07ac-4e7f-9127-1281c94c5724'} Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:04:26.978827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:04:26.980052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:26.981161 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1b31123d-993f-4ed3-9641-7aa481a81ba9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Returning 404 to user: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:04:26.981161 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1b31123d-993f-4ed3-9641-7aa481a81ba9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 404 len: 111 microversion: 2.1 time: 0.031018 Jul 25 06:04:26.981161 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 394/796] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:26 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:04:26.981371 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e166e149-1af1-4976-96dc-f892cc8949ae tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531d020d0>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:27.046462 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e166e149-1af1-4976-96dc-f892cc8949ae tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-394870169" status: 202 len: 0 microversion: 2.1 time: 0.070120 Jul 25 06:04:27.047798 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 403/797] 10.222.0.40 () {58 vars in 1217 bytes} [Mon Jul 25 06:04:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-394870169 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:04:27.700073 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9fba23e2-ce9f-42b8-be27-2b00242b99f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:27.700732 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9fba23e2-ce9f-42b8-be27-2b00242b99f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:27.707033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9fba23e2-ce9f-42b8-be27-2b00242b99f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:27.707479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9fba23e2-ce9f-42b8-be27-2b00242b99f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:27.708262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9fba23e2-ce9f-42b8-be27-2b00242b99f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:27.708692 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9fba23e2-ce9f-42b8-be27-2b00242b99f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:27.783379 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5b1818fb-9ada-4efa-b994-5a18e7375bf6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6531d01550>, body: {"keypair": {"name": "tempest-keypair-1804090546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC2IZD0Y2cBrrxMyHnBVHcw0MSLjymo7ssPsU+TfdDk2AA9hNcNJDpXVNqSchVoM8opTa611oL91rFwDCVJ+3THFhgAv13m+WVFG5qMH2L15RrfSn7tZ/8PcHidEZx+WA=="}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:27.804253 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-5b1818fb-9ada-4efa-b994-5a18e7375bf6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Getting quotas for project 5ea60662f93343019fe380b6e13d5d18. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:04:27.808435 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-5b1818fb-9ada-4efa-b994-5a18e7375bf6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Getting quotas for user a7224418acee432182bf3195bfc8fd99 and project 5ea60662f93343019fe380b6e13d5d18. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:04:27.845809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9fba23e2-ce9f-42b8-be27-2b00242b99f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:27.853690 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9fba23e2-ce9f-42b8-be27-2b00242b99f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:27.855295 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9fba23e2-ce9f-42b8-be27-2b00242b99f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:27.856405 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9fba23e2-ce9f-42b8-be27-2b00242b99f8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1406 microversion: 2.20 time: 0.160966 Jul 25 06:04:27.856953 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 395/798] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:27 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:27.886730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5b1818fb-9ada-4efa-b994-5a18e7375bf6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108195 Jul 25 06:04:27.887331 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 404/799] 10.222.0.40 () {60 vars in 1158 bytes} [Mon Jul 25 06:04:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:04:28.880356 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-cc6b2072-a4d6-414f-b0e3-1efb70fd8c59 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:28.880963 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cc6b2072-a4d6-414f-b0e3-1efb70fd8c59 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:28.882885 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=6 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:28.888315 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cc6b2072-a4d6-414f-b0e3-1efb70fd8c59 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:28.901724 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cc6b2072-a4d6-414f-b0e3-1efb70fd8c59 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:28.901724 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cc6b2072-a4d6-414f-b0e3-1efb70fd8c59 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:28.901724 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cc6b2072-a4d6-414f-b0e3-1efb70fd8c59 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:29.021580 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-cc6b2072-a4d6-414f-b0e3-1efb70fd8c59 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:29.030089 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-cc6b2072-a4d6-414f-b0e3-1efb70fd8c59 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:29.032173 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-cc6b2072-a4d6-414f-b0e3-1efb70fd8c59 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:29.033249 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-cc6b2072-a4d6-414f-b0e3-1efb70fd8c59 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1406 microversion: 2.20 time: 0.156911 Jul 25 06:04:29.033996 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 396/800] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:28 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:30.048635 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:30.053472 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-abe0e065-190e-499c-a4f1-f58dd7544357 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:30.054117 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-abe0e065-190e-499c-a4f1-f58dd7544357 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:30.060387 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-abe0e065-190e-499c-a4f1-f58dd7544357 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:30.060834 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-abe0e065-190e-499c-a4f1-f58dd7544357 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:30.061646 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-abe0e065-190e-499c-a4f1-f58dd7544357 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:30.062074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-abe0e065-190e-499c-a4f1-f58dd7544357 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:30.227185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-abe0e065-190e-499c-a4f1-f58dd7544357 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:30.237309 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-abe0e065-190e-499c-a4f1-f58dd7544357 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:30.239309 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-abe0e065-190e-499c-a4f1-f58dd7544357 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:30.240510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-abe0e065-190e-499c-a4f1-f58dd7544357 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1406 microversion: 2.20 time: 0.193454 Jul 25 06:04:30.241251 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 405/801] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:30 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:30.260697 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1462136841", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8aa6446-1bfa-4069-a27c-c14f749ca6da"}], "security_groups": [{"name": "tempest-securitygroup--330834639"}], "key_name": "tempest-keypair-1804090546", "user_data": "}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:30.386726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] validate_networks() for [('e8aa6446-1bfa-4069-a27c-c14f749ca6da', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:04:31.084054 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:04:31.084505 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:04:31.088019 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:04:31.088019 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:04:31.088019 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:04:31.094738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:31.095179 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:31.095990 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:31.096450 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:31.113750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Getting quotas for project 5ea60662f93343019fe380b6e13d5d18. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:04:31.117887 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Getting quotas for user a7224418acee432182bf3195bfc8fd99 and project 5ea60662f93343019fe380b6e13d5d18. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:04:31.129849 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:04:31.132100 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:04:31.253097 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e64622df-a56d-46e4-a936-795ed5cda665 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.997932 Jul 25 06:04:31.254216 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 397/802] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:04:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:04:31.259414 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4edf9ef7-de16-4438-b51e-9deb43092153 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:31.260226 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4edf9ef7-de16-4438-b51e-9deb43092153 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:31.267699 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-66e28c33-b3e6-4a36-a4ba-20034cc91da0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:31.268337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-66e28c33-b3e6-4a36-a4ba-20034cc91da0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:31.268643 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4edf9ef7-de16-4438-b51e-9deb43092153 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:31.269130 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4edf9ef7-de16-4438-b51e-9deb43092153 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:31.269937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4edf9ef7-de16-4438-b51e-9deb43092153 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:31.270552 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4edf9ef7-de16-4438-b51e-9deb43092153 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:31.291408 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:31.348063 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-66e28c33-b3e6-4a36-a4ba-20034cc91da0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:31.355811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-66e28c33-b3e6-4a36-a4ba-20034cc91da0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1238 microversion: 2.1 time: 0.092466 Jul 25 06:04:31.356530 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 398/803] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:31 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:31.485389 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4edf9ef7-de16-4438-b51e-9deb43092153 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:31.495063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4edf9ef7-de16-4438-b51e-9deb43092153 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:31.496690 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4edf9ef7-de16-4438-b51e-9deb43092153 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:31.497805 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4edf9ef7-de16-4438-b51e-9deb43092153 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1406 microversion: 2.20 time: 0.242738 Jul 25 06:04:31.508717 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 406/804] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:31 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:04:31.725910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-e9cd9d8c-67d4-4fe4-ab93-7b24153892b8 req-5ff2f956-4728-48ef-bbce-7313a6cbe217 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "5e834f53-fb25-48ed-a03c-33717c1e39ff", "name": "network-vif-plugged", "status": "completed", "tag": "ca3ad013-ac59-49fd-a355-d63dbc1c3385"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:31.734258 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-e9cd9d8c-67d4-4fe4-ab93-7b24153892b8 req-5ff2f956-4728-48ef-bbce-7313a6cbe217 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:31.734705 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-e9cd9d8c-67d4-4fe4-ab93-7b24153892b8 req-5ff2f956-4728-48ef-bbce-7313a6cbe217 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:31.746548 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-e9cd9d8c-67d4-4fe4-ab93-7b24153892b8 req-5ff2f956-4728-48ef-bbce-7313a6cbe217 service nova] Creating event network-vif-plugged:ca3ad013-ac59-49fd-a355-d63dbc1c3385 for instance 5e834f53-fb25-48ed-a03c-33717c1e39ff on hv-cinder-84841 Jul 25 06:04:31.752444 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-e9cd9d8c-67d4-4fe4-ab93-7b24153892b8 req-5ff2f956-4728-48ef-bbce-7313a6cbe217 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030221 Jul 25 06:04:31.753518 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 399/805] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:32.373288 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-be5177aa-dc7a-4a46-a427-ab2b670aa7c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:32.373885 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-be5177aa-dc7a-4a46-a427-ab2b670aa7c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:32.380471 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-be5177aa-dc7a-4a46-a427-ab2b670aa7c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.380917 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-be5177aa-dc7a-4a46-a427-ab2b670aa7c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.381669 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-be5177aa-dc7a-4a46-a427-ab2b670aa7c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.382104 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-be5177aa-dc7a-4a46-a427-ab2b670aa7c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.441840 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-be5177aa-dc7a-4a46-a427-ab2b670aa7c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:32.449141 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-be5177aa-dc7a-4a46-a427-ab2b670aa7c8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1242 microversion: 2.1 time: 0.079681 Jul 25 06:04:32.449636 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 407/806] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:32 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:32.517053 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7b0efb17-e283-40f7-b335-886595b1f7e5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:32.517752 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7b0efb17-e283-40f7-b335-886595b1f7e5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:32.524697 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7b0efb17-e283-40f7-b335-886595b1f7e5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.525147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7b0efb17-e283-40f7-b335-886595b1f7e5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.525906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7b0efb17-e283-40f7-b335-886595b1f7e5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:32.526344 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7b0efb17-e283-40f7-b335-886595b1f7e5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:32.663148 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7b0efb17-e283-40f7-b335-886595b1f7e5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:32.671156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7b0efb17-e283-40f7-b335-886595b1f7e5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:32.672707 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7b0efb17-e283-40f7-b335-886595b1f7e5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:32.674468 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7b0efb17-e283-40f7-b335-886595b1f7e5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1406 microversion: 2.20 time: 0.161922 Jul 25 06:04:32.675033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 400/807] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:32 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:33.466135 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2a1fb32c-f6e1-4303-a060-8f1a37271ad9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:33.466748 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2a1fb32c-f6e1-4303-a060-8f1a37271ad9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:33.473722 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2a1fb32c-f6e1-4303-a060-8f1a37271ad9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.474202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2a1fb32c-f6e1-4303-a060-8f1a37271ad9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.475526 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2a1fb32c-f6e1-4303-a060-8f1a37271ad9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.475986 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2a1fb32c-f6e1-4303-a060-8f1a37271ad9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.543881 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2a1fb32c-f6e1-4303-a060-8f1a37271ad9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:33.551853 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2a1fb32c-f6e1-4303-a060-8f1a37271ad9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1290 microversion: 2.1 time: 0.090335 Jul 25 06:04:33.552442 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 408/808] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:33 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:33.693210 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c46d780e-4637-4b51-8721-fa04d830fe0f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:33.693817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c46d780e-4637-4b51-8721-fa04d830fe0f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:33.700253 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c46d780e-4637-4b51-8721-fa04d830fe0f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.700694 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c46d780e-4637-4b51-8721-fa04d830fe0f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.701442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c46d780e-4637-4b51-8721-fa04d830fe0f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:33.701870 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c46d780e-4637-4b51-8721-fa04d830fe0f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:33.828980 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c46d780e-4637-4b51-8721-fa04d830fe0f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:33.837027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c46d780e-4637-4b51-8721-fa04d830fe0f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:33.838526 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c46d780e-4637-4b51-8721-fa04d830fe0f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:33.839608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c46d780e-4637-4b51-8721-fa04d830fe0f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1406 microversion: 2.20 time: 0.151007 Jul 25 06:04:33.840179 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 401/809] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:33 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:04:34.806699 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-69b1f8ce-8a07-443a-8e1b-0c0544aad416 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:34.807610 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-69b1f8ce-8a07-443a-8e1b-0c0544aad416 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:34.815227 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-69b1f8ce-8a07-443a-8e1b-0c0544aad416 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:34.815675 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-69b1f8ce-8a07-443a-8e1b-0c0544aad416 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:34.821508 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-69b1f8ce-8a07-443a-8e1b-0c0544aad416 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:34.821508 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-69b1f8ce-8a07-443a-8e1b-0c0544aad416 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:34.858339 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-464555fc-4719-4ed5-beac-053f8cc76111 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:34.858945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-464555fc-4719-4ed5-beac-053f8cc76111 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:34.866677 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-464555fc-4719-4ed5-beac-053f8cc76111 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:34.867125 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-464555fc-4719-4ed5-beac-053f8cc76111 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:34.867893 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-464555fc-4719-4ed5-beac-053f8cc76111 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:34.868480 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-464555fc-4719-4ed5-beac-053f8cc76111 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:34.905926 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-69b1f8ce-8a07-443a-8e1b-0c0544aad416 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:34.914388 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-69b1f8ce-8a07-443a-8e1b-0c0544aad416 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1298 microversion: 2.1 time: 0.349824 Jul 25 06:04:34.915574 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 409/810] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:34 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1298 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:35.014676 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-464555fc-4719-4ed5-beac-053f8cc76111 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:35.025314 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-464555fc-4719-4ed5-beac-053f8cc76111 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:35.026870 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-464555fc-4719-4ed5-beac-053f8cc76111 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:35.028040 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-464555fc-4719-4ed5-beac-053f8cc76111 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1597 microversion: 2.20 time: 0.173714 Jul 25 06:04:35.028639 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 402/811] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:04:34 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1597 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:04:35.046390 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2964a40e-d66d-4daf-85a8-8e96811164cd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method InterfaceAttachmentController.index of <nova.api.openstack.compute.attach_interfaces.InterfaceAttachmentController object at 0x7f6533f0dd90>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:35.046892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2964a40e-d66d-4daf-85a8-8e96811164cd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:35.053702 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2964a40e-d66d-4daf-85a8-8e96811164cd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:35.054152 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2964a40e-d66d-4daf-85a8-8e96811164cd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:35.054917 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2964a40e-d66d-4daf-85a8-8e96811164cd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:35.055349 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2964a40e-d66d-4daf-85a8-8e96811164cd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:35.165082 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2964a40e-d66d-4daf-85a8-8e96811164cd tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122766 Jul 25 06:04:35.165716 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 410/812] 10.222.0.40 () {60 vars in 1315 bytes} [Mon Jul 25 06:04:35 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 06:04:35.933627 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4fbc984e-57be-455c-8303-3b080df61159 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:35.941854 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4fbc984e-57be-455c-8303-3b080df61159 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:35.941854 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4fbc984e-57be-455c-8303-3b080df61159 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:35.941854 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4fbc984e-57be-455c-8303-3b080df61159 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:35.942848 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4fbc984e-57be-455c-8303-3b080df61159 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:35.943287 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4fbc984e-57be-455c-8303-3b080df61159 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:36.146102 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4fbc984e-57be-455c-8303-3b080df61159 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:36.155084 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4fbc984e-57be-455c-8303-3b080df61159 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1363 microversion: 2.1 time: 0.226076 Jul 25 06:04:36.158673 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 403/813] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:35 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:36.292370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-79fa8865-2865-46af-b865-5f078596f39c req-b18b4a72-ff36-4bfc-958e-79c5ab32d35c service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "5e834f53-fb25-48ed-a03c-33717c1e39ff", "tag": "ca3ad013-ac59-49fd-a355-d63dbc1c3385"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:36.302685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-79fa8865-2865-46af-b865-5f078596f39c req-b18b4a72-ff36-4bfc-958e-79c5ab32d35c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:36.303129 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-79fa8865-2865-46af-b865-5f078596f39c req-b18b4a72-ff36-4bfc-958e-79c5ab32d35c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:36.326512 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-79fa8865-2865-46af-b865-5f078596f39c req-b18b4a72-ff36-4bfc-958e-79c5ab32d35c service nova] Creating event network-changed:ca3ad013-ac59-49fd-a355-d63dbc1c3385 for instance 5e834f53-fb25-48ed-a03c-33717c1e39ff on hv-cinder-84841 Jul 25 06:04:36.332652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-79fa8865-2865-46af-b865-5f078596f39c req-b18b4a72-ff36-4bfc-958e-79c5ab32d35c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043737 Jul 25 06:04:36.333963 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 411/814] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:36.886094 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-a332a735-6c98-40e3-8033-f70c4eac3204 req-478936c3-e4e4-45d1-a2f6-c34b426fee6f service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b", "tag": "4c6f1034-2014-4ea0-93a6-b1cb240056db"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:36.901075 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-a332a735-6c98-40e3-8033-f70c4eac3204 req-478936c3-e4e4-45d1-a2f6-c34b426fee6f service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:36.901528 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-a332a735-6c98-40e3-8033-f70c4eac3204 req-478936c3-e4e4-45d1-a2f6-c34b426fee6f service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:36.927563 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-a332a735-6c98-40e3-8033-f70c4eac3204 req-478936c3-e4e4-45d1-a2f6-c34b426fee6f service nova] Creating event network-changed:4c6f1034-2014-4ea0-93a6-b1cb240056db for instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b on hv-cinder-84841 Jul 25 06:04:36.933696 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-a332a735-6c98-40e3-8033-f70c4eac3204 req-478936c3-e4e4-45d1-a2f6-c34b426fee6f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051604 Jul 25 06:04:36.939474 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 404/815] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:37.172745 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5565661a-2eb3-49b1-aeff-105f235f3d5d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:37.174003 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5565661a-2eb3-49b1-aeff-105f235f3d5d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:37.182950 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5565661a-2eb3-49b1-aeff-105f235f3d5d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.183408 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5565661a-2eb3-49b1-aeff-105f235f3d5d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.184214 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5565661a-2eb3-49b1-aeff-105f235f3d5d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.184672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5565661a-2eb3-49b1-aeff-105f235f3d5d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.361426 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5565661a-2eb3-49b1-aeff-105f235f3d5d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:37.369170 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5565661a-2eb3-49b1-aeff-105f235f3d5d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1363 microversion: 2.1 time: 0.201290 Jul 25 06:04:37.379214 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 412/816] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:37 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:37.474754 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-01e84e20-d2e5-4629-9efd-e0cfcb8070e8 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Action: 'action', calling method: <bound method ServersController._action_reboot of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f3c8e0>>, body: {"reboot": {"type": "SOFT"}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:37.475796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-01e84e20-d2e5-4629-9efd-e0cfcb8070e8 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:37.482680 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01e84e20-d2e5-4629-9efd-e0cfcb8070e8 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.483153 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01e84e20-d2e5-4629-9efd-e0cfcb8070e8 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.483921 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01e84e20-d2e5-4629-9efd-e0cfcb8070e8 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.484387 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-01e84e20-d2e5-4629-9efd-e0cfcb8070e8 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.721444 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-01e84e20-d2e5-4629-9efd-e0cfcb8070e8 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "POST /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.251071 Jul 25 06:04:37.722226 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 405/817] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:04:37 2022] POST /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:04:37.730707 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6fbe0d2c-e99a-45c6-a264-7823472827c1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:37.731315 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6fbe0d2c-e99a-45c6-a264-7823472827c1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:37.738784 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6fbe0d2c-e99a-45c6-a264-7823472827c1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.739324 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6fbe0d2c-e99a-45c6-a264-7823472827c1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.740390 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6fbe0d2c-e99a-45c6-a264-7823472827c1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:37.740890 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6fbe0d2c-e99a-45c6-a264-7823472827c1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:37.814972 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=10 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:37.884534 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6fbe0d2c-e99a-45c6-a264-7823472827c1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:37.893547 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6fbe0d2c-e99a-45c6-a264-7823472827c1 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1750 microversion: 2.1 time: 0.167037 Jul 25 06:04:37.894110 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 413/818] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:37 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:38.387358 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a597b83e-212a-4910-8a44-185029a3745f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:38.387974 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-a597b83e-212a-4910-8a44-185029a3745f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:38.394817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a597b83e-212a-4910-8a44-185029a3745f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:38.395260 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a597b83e-212a-4910-8a44-185029a3745f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:38.396006 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a597b83e-212a-4910-8a44-185029a3745f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:38.396462 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a597b83e-212a-4910-8a44-185029a3745f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:38.525702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a597b83e-212a-4910-8a44-185029a3745f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:38.533156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a597b83e-212a-4910-8a44-185029a3745f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1363 microversion: 2.1 time: 0.150119 Jul 25 06:04:38.533717 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 406/819] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:38 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:38.912519 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8cad529b-6221-45d8-afa0-5ae844842483 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:38.913127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-8cad529b-6221-45d8-afa0-5ae844842483 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:38.920096 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8cad529b-6221-45d8-afa0-5ae844842483 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:38.920571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8cad529b-6221-45d8-afa0-5ae844842483 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:38.921317 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8cad529b-6221-45d8-afa0-5ae844842483 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:38.921745 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8cad529b-6221-45d8-afa0-5ae844842483 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:39.143998 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8cad529b-6221-45d8-afa0-5ae844842483 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:39.152518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8cad529b-6221-45d8-afa0-5ae844842483 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1750 microversion: 2.1 time: 0.243702 Jul 25 06:04:39.152883 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 414/820] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:38 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1750 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:39.550008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-78e8b334-b1d9-4f16-9717-98456884591b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:39.550648 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-78e8b334-b1d9-4f16-9717-98456884591b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:39.557129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78e8b334-b1d9-4f16-9717-98456884591b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:39.557575 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78e8b334-b1d9-4f16-9717-98456884591b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:39.558332 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78e8b334-b1d9-4f16-9717-98456884591b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:39.558766 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-78e8b334-b1d9-4f16-9717-98456884591b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:39.690572 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-78e8b334-b1d9-4f16-9717-98456884591b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:39.698134 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-78e8b334-b1d9-4f16-9717-98456884591b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1363 microversion: 2.1 time: 0.151937 Jul 25 06:04:39.698702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 407/821] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:39 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:40.170237 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5b7333dd-3910-4a7b-b8e8-cee4c107aad6 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:40.170837 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5b7333dd-3910-4a7b-b8e8-cee4c107aad6 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:40.177777 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b7333dd-3910-4a7b-b8e8-cee4c107aad6 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.178213 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b7333dd-3910-4a7b-b8e8-cee4c107aad6 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.178968 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b7333dd-3910-4a7b-b8e8-cee4c107aad6 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.179393 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b7333dd-3910-4a7b-b8e8-cee4c107aad6 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.320796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5b7333dd-3910-4a7b-b8e8-cee4c107aad6 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:40.328725 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5b7333dd-3910-4a7b-b8e8-cee4c107aad6 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.162316 Jul 25 06:04:40.329296 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 415/822] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:40 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:40.454753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-fa60842d-b795-48cf-8115-3f414baae626 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4880>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:40.455251 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-fa60842d-b795-48cf-8115-3f414baae626 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:40.461225 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fa60842d-b795-48cf-8115-3f414baae626 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.461673 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fa60842d-b795-48cf-8115-3f414baae626 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.462428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fa60842d-b795-48cf-8115-3f414baae626 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.462862 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fa60842d-b795-48cf-8115-3f414baae626 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.545892 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-fa60842d-b795-48cf-8115-3f414baae626 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lazy-loading 'services' on Instance uuid e750488b-116b-4f02-a4bd-710c3867fa27 {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:40.715619 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1195b41d-3b94-4e94-b5d0-088ae75b1446 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:40.718624 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1195b41d-3b94-4e94-b5d0-088ae75b1446 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:40.722365 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1195b41d-3b94-4e94-b5d0-088ae75b1446 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.722809 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1195b41d-3b94-4e94-b5d0-088ae75b1446 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.723662 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1195b41d-3b94-4e94-b5d0-088ae75b1446 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.724096 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1195b41d-3b94-4e94-b5d0-088ae75b1446 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.768148 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-fa60842d-b795-48cf-8115-3f414baae626 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-volume_attachments/2d82e4b9-5a46-49a2-b9a1-3625c146b23d" status: 202 len: 0 microversion: 2.1 time: 0.316439 Jul 25 06:04:40.769130 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 408/823] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:04:40 2022] DELETE /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-volume_attachments/2d82e4b9-5a46-49a2-b9a1-3625c146b23d => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:04:40.861643 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1195b41d-3b94-4e94-b5d0-088ae75b1446 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:40.869975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1195b41d-3b94-4e94-b5d0-088ae75b1446 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1363 microversion: 2.1 time: 0.157582 Jul 25 06:04:40.870090 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 416/824] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:40 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:40.885493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d085adac-0eec-47f4-91ae-2be632aa5bd6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:40.891499 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d085adac-0eec-47f4-91ae-2be632aa5bd6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:40.893748 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d085adac-0eec-47f4-91ae-2be632aa5bd6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.894203 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d085adac-0eec-47f4-91ae-2be632aa5bd6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.895005 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d085adac-0eec-47f4-91ae-2be632aa5bd6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:40.895442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d085adac-0eec-47f4-91ae-2be632aa5bd6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:40.920920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:40.926193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d085adac-0eec-47f4-91ae-2be632aa5bd6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152535 Jul 25 06:04:40.926765 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 409/825] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:40 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:04:41.345944 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-883d56c3-f3e3-4d76-93c7-8e1dddc5d69b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:41.346484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-883d56c3-f3e3-4d76-93c7-8e1dddc5d69b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:41.353081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-883d56c3-f3e3-4d76-93c7-8e1dddc5d69b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:41.353524 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-883d56c3-f3e3-4d76-93c7-8e1dddc5d69b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:41.354284 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-883d56c3-f3e3-4d76-93c7-8e1dddc5d69b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:41.354712 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-883d56c3-f3e3-4d76-93c7-8e1dddc5d69b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:41.502645 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-883d56c3-f3e3-4d76-93c7-8e1dddc5d69b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:41.510865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-883d56c3-f3e3-4d76-93c7-8e1dddc5d69b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.169027 Jul 25 06:04:41.521738 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 417/826] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:41 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:41.887200 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9d03c388-8bdc-497e-864e-3448c77c705a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:41.887753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9d03c388-8bdc-497e-864e-3448c77c705a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:41.889541 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:41.890254 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=8 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:41.896510 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9d03c388-8bdc-497e-864e-3448c77c705a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:41.898261 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9d03c388-8bdc-497e-864e-3448c77c705a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:41.898261 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9d03c388-8bdc-497e-864e-3448c77c705a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:41.898457 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9d03c388-8bdc-497e-864e-3448c77c705a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:41.941145 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3bd95a9e-8ac4-4d81-9889-fe0020b335a3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:41.942130 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3bd95a9e-8ac4-4d81-9889-fe0020b335a3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:41.948606 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3bd95a9e-8ac4-4d81-9889-fe0020b335a3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:41.949053 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3bd95a9e-8ac4-4d81-9889-fe0020b335a3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:41.949832 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3bd95a9e-8ac4-4d81-9889-fe0020b335a3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:41.950263 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3bd95a9e-8ac4-4d81-9889-fe0020b335a3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:41.981278 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3bd95a9e-8ac4-4d81-9889-fe0020b335a3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044031 Jul 25 06:04:41.982293 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 418/827] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:41 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:04:42.037576 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9d03c388-8bdc-497e-864e-3448c77c705a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:42.045168 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9d03c388-8bdc-497e-864e-3448c77c705a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1363 microversion: 2.1 time: 0.162288 Jul 25 06:04:42.045729 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 410/828] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:41 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:42.062160 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-bfb1aa1b-6418-4eea-a675-e7abce6855b9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:42.062650 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-bfb1aa1b-6418-4eea-a675-e7abce6855b9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:42.068761 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bfb1aa1b-6418-4eea-a675-e7abce6855b9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:42.069201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bfb1aa1b-6418-4eea-a675-e7abce6855b9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:42.069953 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bfb1aa1b-6418-4eea-a675-e7abce6855b9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:42.070655 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-bfb1aa1b-6418-4eea-a675-e7abce6855b9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:42.094887 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-bfb1aa1b-6418-4eea-a675-e7abce6855b9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:04:42.425714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-bfb1aa1b-6418-4eea-a675-e7abce6855b9 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 204 len: 0 microversion: 2.1 time: 0.367130 Jul 25 06:04:42.426314 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 419/829] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:04:42 2022] DELETE /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:04:42.434704 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-48837ac3-e905-4757-9da6-9acaa2d284f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:42.435487 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-48837ac3-e905-4757-9da6-9acaa2d284f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:42.441964 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48837ac3-e905-4757-9da6-9acaa2d284f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:42.446082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48837ac3-e905-4757-9da6-9acaa2d284f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:42.446082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48837ac3-e905-4757-9da6-9acaa2d284f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:42.446082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48837ac3-e905-4757-9da6-9acaa2d284f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:42.528811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-349bec3e-dc9a-472f-a953-b6a2e3a17db5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:42.532187 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-349bec3e-dc9a-472f-a953-b6a2e3a17db5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:42.536585 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-349bec3e-dc9a-472f-a953-b6a2e3a17db5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:42.537029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-349bec3e-dc9a-472f-a953-b6a2e3a17db5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:42.537790 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-349bec3e-dc9a-472f-a953-b6a2e3a17db5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:42.538218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-349bec3e-dc9a-472f-a953-b6a2e3a17db5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:42.578266 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-48837ac3-e905-4757-9da6-9acaa2d284f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:42.586654 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-48837ac3-e905-4757-9da6-9acaa2d284f0 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1689 microversion: 2.1 time: 0.156204 Jul 25 06:04:42.587952 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 411/830] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:42 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:42.684235 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-349bec3e-dc9a-472f-a953-b6a2e3a17db5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:42.692286 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-349bec3e-dc9a-472f-a953-b6a2e3a17db5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.167652 Jul 25 06:04:42.692854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 420/831] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:42 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:43.061746 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7457a963-f64e-4e47-bc09-565c9dc0474b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:43.062280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7457a963-f64e-4e47-bc09-565c9dc0474b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:43.069427 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7457a963-f64e-4e47-bc09-565c9dc0474b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:43.069882 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7457a963-f64e-4e47-bc09-565c9dc0474b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:43.070712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7457a963-f64e-4e47-bc09-565c9dc0474b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:43.071154 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7457a963-f64e-4e47-bc09-565c9dc0474b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:43.198018 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7457a963-f64e-4e47-bc09-565c9dc0474b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:43.205395 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7457a963-f64e-4e47-bc09-565c9dc0474b tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1363 microversion: 2.1 time: 0.147658 Jul 25 06:04:43.205957 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 412/832] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:43 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:43.603422 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fd3b0487-2437-44ee-b9b6-51c8c99d48cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:43.606106 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-fd3b0487-2437-44ee-b9b6-51c8c99d48cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:43.611582 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd3b0487-2437-44ee-b9b6-51c8c99d48cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:43.612040 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd3b0487-2437-44ee-b9b6-51c8c99d48cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:43.612825 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd3b0487-2437-44ee-b9b6-51c8c99d48cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:43.613263 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd3b0487-2437-44ee-b9b6-51c8c99d48cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:43.709420 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6b9a4dfa-0ab2-48cc-90c3-235cfdec3623 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:43.710047 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6b9a4dfa-0ab2-48cc-90c3-235cfdec3623 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:43.716212 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6b9a4dfa-0ab2-48cc-90c3-235cfdec3623 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:43.716753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6b9a4dfa-0ab2-48cc-90c3-235cfdec3623 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:43.717585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6b9a4dfa-0ab2-48cc-90c3-235cfdec3623 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:43.718100 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6b9a4dfa-0ab2-48cc-90c3-235cfdec3623 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:43.757014 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-fd3b0487-2437-44ee-b9b6-51c8c99d48cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:43.774909 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-fd3b0487-2437-44ee-b9b6-51c8c99d48cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1689 microversion: 2.1 time: 0.175253 Jul 25 06:04:43.775660 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 421/833] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:43 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:43.780064 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-0cc33775-78eb-4574-81e6-8904c6e13082 req-ce1c3c4c-86f0-4b08-97df-543f5fed207e service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b", "name": "network-vif-plugged", "status": "completed", "tag": "4c6f1034-2014-4ea0-93a6-b1cb240056db"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:43.785169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:43.789161 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-0cc33775-78eb-4574-81e6-8904c6e13082 req-ce1c3c4c-86f0-4b08-97df-543f5fed207e service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:43.790098 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-0cc33775-78eb-4574-81e6-8904c6e13082 req-ce1c3c4c-86f0-4b08-97df-543f5fed207e service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:43.800957 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-0cc33775-78eb-4574-81e6-8904c6e13082 req-ce1c3c4c-86f0-4b08-97df-543f5fed207e service nova] Creating event network-vif-plugged:4c6f1034-2014-4ea0-93a6-b1cb240056db for instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b on hv-cinder-84841 Jul 25 06:04:43.805695 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-0cc33775-78eb-4574-81e6-8904c6e13082 req-ce1c3c4c-86f0-4b08-97df-543f5fed207e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029120 Jul 25 06:04:43.806279 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 422/834] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:43.868602 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6b9a4dfa-0ab2-48cc-90c3-235cfdec3623 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:43.876769 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6b9a4dfa-0ab2-48cc-90c3-235cfdec3623 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.171376 Jul 25 06:04:43.877341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 413/835] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:43 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:44.223724 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4b630eb8-915f-4fa0-b157-05e4d6cd2f08 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:44.224442 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4b630eb8-915f-4fa0-b157-05e4d6cd2f08 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:44.231100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b630eb8-915f-4fa0-b157-05e4d6cd2f08 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:44.231545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b630eb8-915f-4fa0-b157-05e4d6cd2f08 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:44.232332 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b630eb8-915f-4fa0-b157-05e4d6cd2f08 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:44.232770 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4b630eb8-915f-4fa0-b157-05e4d6cd2f08 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:44.236721 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:44.362494 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4b630eb8-915f-4fa0-b157-05e4d6cd2f08 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:44.369835 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4b630eb8-915f-4fa0-b157-05e4d6cd2f08 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1363 microversion: 2.1 time: 0.151401 Jul 25 06:04:44.370403 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 423/836] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:44 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:44.793573 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5ef5a3b1-8fae-4a7a-be63-d1304cba0ad2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:44.794202 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5ef5a3b1-8fae-4a7a-be63-d1304cba0ad2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:44.800817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ef5a3b1-8fae-4a7a-be63-d1304cba0ad2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:44.801266 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ef5a3b1-8fae-4a7a-be63-d1304cba0ad2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:44.802020 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ef5a3b1-8fae-4a7a-be63-d1304cba0ad2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:44.802456 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ef5a3b1-8fae-4a7a-be63-d1304cba0ad2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:44.894384 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7bb1ee19-9180-4526-9f17-3ba6e62a6dc5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:44.895022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7bb1ee19-9180-4526-9f17-3ba6e62a6dc5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:44.902422 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bb1ee19-9180-4526-9f17-3ba6e62a6dc5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:44.902865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bb1ee19-9180-4526-9f17-3ba6e62a6dc5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:44.903629 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bb1ee19-9180-4526-9f17-3ba6e62a6dc5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:44.904063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7bb1ee19-9180-4526-9f17-3ba6e62a6dc5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:44.937899 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5ef5a3b1-8fae-4a7a-be63-d1304cba0ad2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:44.946171 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5ef5a3b1-8fae-4a7a-be63-d1304cba0ad2 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1689 microversion: 2.1 time: 0.156578 Jul 25 06:04:44.946741 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 414/837] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:44 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:45.045161 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7bb1ee19-9180-4526-9f17-3ba6e62a6dc5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:45.053712 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7bb1ee19-9180-4526-9f17-3ba6e62a6dc5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.163554 Jul 25 06:04:45.054278 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 424/838] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:44 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:45.387469 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f1984416-d409-44e9-9557-9e25ae27dbe4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:45.388144 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f1984416-d409-44e9-9557-9e25ae27dbe4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:45.394415 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f1984416-d409-44e9-9557-9e25ae27dbe4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:45.394859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f1984416-d409-44e9-9557-9e25ae27dbe4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:45.395609 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f1984416-d409-44e9-9557-9e25ae27dbe4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:45.396040 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f1984416-d409-44e9-9557-9e25ae27dbe4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:45.524099 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f1984416-d409-44e9-9557-9e25ae27dbe4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:45.533116 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f1984416-d409-44e9-9557-9e25ae27dbe4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1363 microversion: 2.1 time: 0.149559 Jul 25 06:04:45.533674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 415/839] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:45 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:45.963482 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-56bd3efc-5e44-4aa5-9ba4-59b0ab1291a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:45.964307 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-56bd3efc-5e44-4aa5-9ba4-59b0ab1291a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:45.971475 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-56bd3efc-5e44-4aa5-9ba4-59b0ab1291a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:45.973146 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-56bd3efc-5e44-4aa5-9ba4-59b0ab1291a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:45.973512 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-56bd3efc-5e44-4aa5-9ba4-59b0ab1291a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:45.974349 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-56bd3efc-5e44-4aa5-9ba4-59b0ab1291a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:46.062688 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-55b8f1f1-5e1f-4683-a31c-43bcd6f4bcde tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method IPsController.index of <nova.api.openstack.compute.ips.IPsController object at 0x7f6533ee6fa0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:46.070451 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-55b8f1f1-5e1f-4683-a31c-43bcd6f4bcde tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:46.075059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55b8f1f1-5e1f-4683-a31c-43bcd6f4bcde tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:46.075507 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55b8f1f1-5e1f-4683-a31c-43bcd6f4bcde tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:46.076521 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55b8f1f1-5e1f-4683-a31c-43bcd6f4bcde tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:46.076958 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55b8f1f1-5e1f-4683-a31c-43bcd6f4bcde tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:46.104633 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-55b8f1f1-5e1f-4683-a31c-43bcd6f4bcde tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/ips" status: 200 len: 150 microversion: 2.1 time: 0.162393 Jul 25 06:04:46.105672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 425/840] 10.222.0.40 () {58 vars in 1247 bytes} [Mon Jul 25 06:04:45 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/ips => generated 150 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:04:46.112999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-32b4794e-5b57-49ee-8048-f3cb95550216 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:46.112999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-32b4794e-5b57-49ee-8048-f3cb95550216 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:46.123018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32b4794e-5b57-49ee-8048-f3cb95550216 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:46.123018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32b4794e-5b57-49ee-8048-f3cb95550216 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:46.123018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32b4794e-5b57-49ee-8048-f3cb95550216 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:46.123018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32b4794e-5b57-49ee-8048-f3cb95550216 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:46.156236 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-56bd3efc-5e44-4aa5-9ba4-59b0ab1291a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:46.172605 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-56bd3efc-5e44-4aa5-9ba4-59b0ab1291a6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1689 microversion: 2.1 time: 0.212904 Jul 25 06:04:46.180975 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 416/841] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:45 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1689 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:46.410514 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-32b4794e-5b57-49ee-8048-f3cb95550216 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:46.418999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-32b4794e-5b57-49ee-8048-f3cb95550216 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.312180 Jul 25 06:04:46.419637 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 426/842] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:46 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:46.550411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f97c81ac-5714-420b-8f07-b0d2e11c94b9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:46.551134 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f97c81ac-5714-420b-8f07-b0d2e11c94b9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:46.557267 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f97c81ac-5714-420b-8f07-b0d2e11c94b9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:46.557768 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f97c81ac-5714-420b-8f07-b0d2e11c94b9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:46.558516 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f97c81ac-5714-420b-8f07-b0d2e11c94b9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:46.558945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f97c81ac-5714-420b-8f07-b0d2e11c94b9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:46.717665 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f97c81ac-5714-420b-8f07-b0d2e11c94b9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:46.727578 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f97c81ac-5714-420b-8f07-b0d2e11c94b9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1363 microversion: 2.1 time: 0.181539 Jul 25 06:04:46.730136 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 417/843] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:46 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:47.084257 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-b4239dbf-ce5b-4f46-a56f-2693257740d7 req-094173b6-7a3d-4bf6-b3a2-065b4447dfcd service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "e750488b-116b-4f02-a4bd-710c3867fa27", "name": "network-vif-deleted", "tag": "f054b336-0d1e-4689-ae9f-d24089cd4d40"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:47.092819 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-b4239dbf-ce5b-4f46-a56f-2693257740d7 req-094173b6-7a3d-4bf6-b3a2-065b4447dfcd service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.093259 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-b4239dbf-ce5b-4f46-a56f-2693257740d7 req-094173b6-7a3d-4bf6-b3a2-065b4447dfcd service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.105457 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-b4239dbf-ce5b-4f46-a56f-2693257740d7 req-094173b6-7a3d-4bf6-b3a2-065b4447dfcd service nova] Creating event network-vif-deleted:f054b336-0d1e-4689-ae9f-d24089cd4d40 for instance e750488b-116b-4f02-a4bd-710c3867fa27 on hv-cinder-84841 Jul 25 06:04:47.110364 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-b4239dbf-ce5b-4f46-a56f-2693257740d7 req-094173b6-7a3d-4bf6-b3a2-065b4447dfcd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030755 Jul 25 06:04:47.110984 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 427/844] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:47.190496 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-bb2639f4-7f06-4ef3-ab34-1ff67fb25ca8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:47.191547 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-bb2639f4-7f06-4ef3-ab34-1ff67fb25ca8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:47.198523 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bb2639f4-7f06-4ef3-ab34-1ff67fb25ca8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.199220 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bb2639f4-7f06-4ef3-ab34-1ff67fb25ca8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.200182 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bb2639f4-7f06-4ef3-ab34-1ff67fb25ca8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.200777 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bb2639f4-7f06-4ef3-ab34-1ff67fb25ca8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.273255 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-bb2639f4-7f06-4ef3-ab34-1ff67fb25ca8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:47.293129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-bb2639f4-7f06-4ef3-ab34-1ff67fb25ca8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1621 microversion: 2.1 time: 0.101487 Jul 25 06:04:47.293129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 418/845] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:47 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1621 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:47.437664 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-15a4c4e2-9887-4245-86b0-863f051b90f5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:47.438376 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-15a4c4e2-9887-4245-86b0-863f051b90f5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:47.444835 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-15a4c4e2-9887-4245-86b0-863f051b90f5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.446513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-15a4c4e2-9887-4245-86b0-863f051b90f5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.446513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-15a4c4e2-9887-4245-86b0-863f051b90f5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.446741 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-15a4c4e2-9887-4245-86b0-863f051b90f5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.606376 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-15a4c4e2-9887-4245-86b0-863f051b90f5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:47.615291 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-15a4c4e2-9887-4245-86b0-863f051b90f5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.181834 Jul 25 06:04:47.615969 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 428/846] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:47 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:47.744640 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c054e95a-82d1-42aa-b4cd-ff0808b67dd8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:47.745245 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c054e95a-82d1-42aa-b4cd-ff0808b67dd8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:47.747121 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:47.751943 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c054e95a-82d1-42aa-b4cd-ff0808b67dd8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.752411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c054e95a-82d1-42aa-b4cd-ff0808b67dd8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.753846 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c054e95a-82d1-42aa-b4cd-ff0808b67dd8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.754284 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c054e95a-82d1-42aa-b4cd-ff0808b67dd8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.898998 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-73f9e319-92e5-43dd-a851-83851516ab5c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f190>>, body: {"volumeAttachment": {"volumeId": "65dbe807-0bad-4170-ab7f-050a145a7bc5"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:47.900539 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-73f9e319-92e5-43dd-a851-83851516ab5c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:47.903903 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c054e95a-82d1-42aa-b4cd-ff0808b67dd8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:47.906381 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-73f9e319-92e5-43dd-a851-83851516ab5c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.906835 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-73f9e319-92e5-43dd-a851-83851516ab5c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.907632 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-73f9e319-92e5-43dd-a851-83851516ab5c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:47.908166 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-73f9e319-92e5-43dd-a851-83851516ab5c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:47.915272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c054e95a-82d1-42aa-b4cd-ff0808b67dd8 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1363 microversion: 2.1 time: 0.174240 Jul 25 06:04:47.916683 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 419/847] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:47 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:48.307093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c1443469-d480-4d9e-8349-19d9a43a1198 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:48.307759 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c1443469-d480-4d9e-8349-19d9a43a1198 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:48.314160 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c1443469-d480-4d9e-8349-19d9a43a1198 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:48.314608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c1443469-d480-4d9e-8349-19d9a43a1198 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:48.315739 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c1443469-d480-4d9e-8349-19d9a43a1198 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:48.315857 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c1443469-d480-4d9e-8349-19d9a43a1198 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:48.351015 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c1443469-d480-4d9e-8349-19d9a43a1198 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:48.351463 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c1443469-d480-4d9e-8349-19d9a43a1198 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:48.351932 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-c1443469-d480-4d9e-8349-19d9a43a1198 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lazy-loading 'fault' on Instance uuid e750488b-116b-4f02-a4bd-710c3867fa27 {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:48.406012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c1443469-d480-4d9e-8349-19d9a43a1198 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:48.414448 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c1443469-d480-4d9e-8349-19d9a43a1198 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 200 len: 1334 microversion: 2.1 time: 0.111222 Jul 25 06:04:48.415217 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 420/848] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:48 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:48.632270 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c67527ec-2ee7-48b1-8b24-db297750bf37 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:48.632826 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c67527ec-2ee7-48b1-8b24-db297750bf37 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:48.638993 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c67527ec-2ee7-48b1-8b24-db297750bf37 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:48.639433 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c67527ec-2ee7-48b1-8b24-db297750bf37 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:48.640273 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c67527ec-2ee7-48b1-8b24-db297750bf37 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:48.640696 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c67527ec-2ee7-48b1-8b24-db297750bf37 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:48.791951 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c67527ec-2ee7-48b1-8b24-db297750bf37 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:48.799912 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c67527ec-2ee7-48b1-8b24-db297750bf37 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.172154 Jul 25 06:04:48.801848 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 421/849] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:48 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:48.809784 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-73f9e319-92e5-43dd-a851-83851516ab5c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.915015 Jul 25 06:04:48.811003 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 429/850] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:04:47 2022] POST /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments => generated 194 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:04:48.934267 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-30c40d3b-cdfb-4dc3-856e-1116584aa9e0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:48.935099 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-30c40d3b-cdfb-4dc3-856e-1116584aa9e0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:48.941680 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-30c40d3b-cdfb-4dc3-856e-1116584aa9e0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:48.942125 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-30c40d3b-cdfb-4dc3-856e-1116584aa9e0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:48.942890 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-30c40d3b-cdfb-4dc3-856e-1116584aa9e0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:48.943319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-30c40d3b-cdfb-4dc3-856e-1116584aa9e0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:49.076427 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-30c40d3b-cdfb-4dc3-856e-1116584aa9e0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:49.084900 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-30c40d3b-cdfb-4dc3-856e-1116584aa9e0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1550 microversion: 2.1 time: 0.154495 Jul 25 06:04:49.085460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 422/851] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:48 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:49.102505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fd5db6e4-be5c-4ca6-8f73-4e2c8d281846 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method InterfaceAttachmentController.index of <nova.api.openstack.compute.attach_interfaces.InterfaceAttachmentController object at 0x7f6533f0dd90>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:49.103078 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-fd5db6e4-be5c-4ca6-8f73-4e2c8d281846 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:49.109271 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd5db6e4-be5c-4ca6-8f73-4e2c8d281846 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:49.109715 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd5db6e4-be5c-4ca6-8f73-4e2c8d281846 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:49.110462 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd5db6e4-be5c-4ca6-8f73-4e2c8d281846 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:49.110890 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fd5db6e4-be5c-4ca6-8f73-4e2c8d281846 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:49.188626 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-fd5db6e4-be5c-4ca6-8f73-4e2c8d281846 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090725 Jul 25 06:04:49.189256 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 430/852] 10.222.0.40 () {58 vars in 1274 bytes} [Mon Jul 25 06:04:49 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:49.431306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-49366f6b-38cc-4d04-baa4-f05e276d4194 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:49.431921 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-49366f6b-38cc-4d04-baa4-f05e276d4194 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: e750488b-116b-4f02-a4bd-710c3867fa27] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:49.438449 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49366f6b-38cc-4d04-baa4-f05e276d4194 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:49.438836 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49366f6b-38cc-4d04-baa4-f05e276d4194 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:49.439598 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49366f6b-38cc-4d04-baa4-f05e276d4194 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:49.440046 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49366f6b-38cc-4d04-baa4-f05e276d4194 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:49.453569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-49366f6b-38cc-4d04-baa4-f05e276d4194 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] HTTP exception thrown: Instance e750488b-116b-4f02-a4bd-710c3867fa27 could not be found. Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-49366f6b-38cc-4d04-baa4-f05e276d4194 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Request method failure captured: Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 HTTP/1.1 Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFNLWQeCYHz8Io1IOt6Hr-lMqJ9K-YweQE3M09yh5R7VR6PG1vMjGfytjWdlaoZHzEo1B_oyLz7Zah8DrhHF8tlpaMtpzBWgxpFZSG7xixeUC3XpV_tpocgpoF3BlRnF2cUrT4CpeLoCBBUGjv0RwbBYMNZ8LqFjtnv-2kVRjdbEIg Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 07562543fa3e40d584b4d4525b112319 Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:04:49.455213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/07562543fa3e40d584b4d4525b112319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07562543fa3e40d584b4d4525b112319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_07562543fa3e40d584b4d4525b112319", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07562543fa3e40d584b4d4525b112319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 07562543fa3e40d584b4d4525b112319 Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-ServerRescueNegativeTestJSON-1718876686-project Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 62e566aa74b045cb8cc6e8edf4a256e1 Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718876686-project Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance e750488b-116b-4f02-a4bd-710c3867fa27 could not be found. Jul 25 06:04:49.457524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'e750488b-116b-4f02-a4bd-710c3867fa27'} Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e750488b-116b-4f02-a4bd-710c3867fa27 could not be found. Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:04:49.458581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e750488b-116b-4f02-a4bd-710c3867fa27 could not be found. Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e750488b-116b-4f02-a4bd-710c3867fa27 could not be found. Jul 25 06:04:49.460331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:49.461733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-49366f6b-38cc-4d04-baa4-f05e276d4194 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Returning 404 to user: Instance e750488b-116b-4f02-a4bd-710c3867fa27 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:04:49.461733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-49366f6b-38cc-4d04-baa4-f05e276d4194 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27" status: 404 len: 111 microversion: 2.1 time: 0.029772 Jul 25 06:04:49.461733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 423/853] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:49 2022] GET /compute/v2.1/servers/e750488b-116b-4f02-a4bd-710c3867fa27 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:04:49.465926 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1fccb1f2-8536-45ea-9d5d-dd874e431a86 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531d8bca0>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:49.552698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1fccb1f2-8536-45ea-9d5d-dd874e431a86 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-918391429" status: 202 len: 0 microversion: 2.1 time: 0.090464 Jul 25 06:04:49.553736 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 431/854] 10.222.0.40 () {58 vars in 1217 bytes} [Mon Jul 25 06:04:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-918391429 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:04:49.818845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-03205b1f-5c10-4c8b-80a3-9be2b98a073d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:49.819728 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-03205b1f-5c10-4c8b-80a3-9be2b98a073d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:49.829688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-03205b1f-5c10-4c8b-80a3-9be2b98a073d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:49.830225 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-03205b1f-5c10-4c8b-80a3-9be2b98a073d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:49.831754 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-03205b1f-5c10-4c8b-80a3-9be2b98a073d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:49.832418 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-03205b1f-5c10-4c8b-80a3-9be2b98a073d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:50.106194 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-03205b1f-5c10-4c8b-80a3-9be2b98a073d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:50.115935 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-03205b1f-5c10-4c8b-80a3-9be2b98a073d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.301952 Jul 25 06:04:50.116775 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 424/855] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:49 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:50.428214 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-9d3837cd-51fd-47bb-9408-9c30097bad6f req-39ff5adb-67d6-4175-9c86-96b3fd6c8282 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b", "tag": "4c6f1034-2014-4ea0-93a6-b1cb240056db"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:50.437531 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-9d3837cd-51fd-47bb-9408-9c30097bad6f req-39ff5adb-67d6-4175-9c86-96b3fd6c8282 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:50.437975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-9d3837cd-51fd-47bb-9408-9c30097bad6f req-39ff5adb-67d6-4175-9c86-96b3fd6c8282 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:50.448534 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-9d3837cd-51fd-47bb-9408-9c30097bad6f req-39ff5adb-67d6-4175-9c86-96b3fd6c8282 service nova] Creating event network-changed:4c6f1034-2014-4ea0-93a6-b1cb240056db for instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b on hv-cinder-84841 Jul 25 06:04:50.453479 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-9d3837cd-51fd-47bb-9408-9c30097bad6f req-39ff5adb-67d6-4175-9c86-96b3fd6c8282 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030951 Jul 25 06:04:50.454086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 432/856] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:51.136660 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7daa886a-39ad-4adb-b622-2b63d16c1ee3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:51.138341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7daa886a-39ad-4adb-b622-2b63d16c1ee3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:51.151435 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7daa886a-39ad-4adb-b622-2b63d16c1ee3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:51.151979 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7daa886a-39ad-4adb-b622-2b63d16c1ee3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:51.152788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7daa886a-39ad-4adb-b622-2b63d16c1ee3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:51.153225 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7daa886a-39ad-4adb-b622-2b63d16c1ee3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:51.306052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7daa886a-39ad-4adb-b622-2b63d16c1ee3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:51.314463 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7daa886a-39ad-4adb-b622-2b63d16c1ee3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.184189 Jul 25 06:04:51.315038 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 425/857] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:51 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:52.333898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9a02b3a9-b917-4307-8ad5-310204b2b3d7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:52.334599 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9a02b3a9-b917-4307-8ad5-310204b2b3d7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:52.340927 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9a02b3a9-b917-4307-8ad5-310204b2b3d7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:52.341373 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9a02b3a9-b917-4307-8ad5-310204b2b3d7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:52.342130 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9a02b3a9-b917-4307-8ad5-310204b2b3d7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:52.342566 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9a02b3a9-b917-4307-8ad5-310204b2b3d7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:52.485982 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9a02b3a9-b917-4307-8ad5-310204b2b3d7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:52.494733 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9a02b3a9-b917-4307-8ad5-310204b2b3d7 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.165813 Jul 25 06:04:52.495295 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 433/858] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:52 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:52.970712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6911435b-a715-4489-b171-ea4cc7405529 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:52.971197 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6911435b-a715-4489-b171-ea4cc7405529 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:52.978645 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6911435b-a715-4489-b171-ea4cc7405529 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:52.979095 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6911435b-a715-4489-b171-ea4cc7405529 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:52.979854 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6911435b-a715-4489-b171-ea4cc7405529 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:52.980327 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6911435b-a715-4489-b171-ea4cc7405529 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.005353 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6911435b-a715-4489-b171-ea4cc7405529 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Going to try to terminate instance {{(pid=124917) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:04:53.008015 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:53.294399 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6911435b-a715-4489-b171-ea4cc7405529 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 204 len: 0 microversion: 2.1 time: 0.327154 Jul 25 06:04:53.294919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 426/859] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:04:52 2022] DELETE /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:04:53.303270 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1a536c36-e541-45f7-a6df-d3bb65482cc6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:53.303868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1a536c36-e541-45f7-a6df-d3bb65482cc6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:53.309975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1a536c36-e541-45f7-a6df-d3bb65482cc6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.310419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1a536c36-e541-45f7-a6df-d3bb65482cc6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.311165 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1a536c36-e541-45f7-a6df-d3bb65482cc6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.311595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1a536c36-e541-45f7-a6df-d3bb65482cc6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.443311 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1a536c36-e541-45f7-a6df-d3bb65482cc6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:53.450735 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1a536c36-e541-45f7-a6df-d3bb65482cc6 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1509 microversion: 2.1 time: 0.151645 Jul 25 06:04:53.451298 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 434/860] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:53 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:53.512347 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6fd6fd22-9204-4259-944c-7273b44f16d4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:53.513033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6fd6fd22-9204-4259-944c-7273b44f16d4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:53.519728 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6fd6fd22-9204-4259-944c-7273b44f16d4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.520301 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6fd6fd22-9204-4259-944c-7273b44f16d4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.521049 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6fd6fd22-9204-4259-944c-7273b44f16d4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:53.521478 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6fd6fd22-9204-4259-944c-7273b44f16d4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:53.661930 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6fd6fd22-9204-4259-944c-7273b44f16d4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:53.669808 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6fd6fd22-9204-4259-944c-7273b44f16d4 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.161684 Jul 25 06:04:53.670359 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 427/861] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:53 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:54.468267 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0fcf46ea-8c8a-456e-ad83-c3dedc60e126 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:54.468881 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-0fcf46ea-8c8a-456e-ad83-c3dedc60e126 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:54.475887 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0fcf46ea-8c8a-456e-ad83-c3dedc60e126 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:54.476356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0fcf46ea-8c8a-456e-ad83-c3dedc60e126 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:54.477115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0fcf46ea-8c8a-456e-ad83-c3dedc60e126 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:54.477549 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0fcf46ea-8c8a-456e-ad83-c3dedc60e126 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:54.604240 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-0fcf46ea-8c8a-456e-ad83-c3dedc60e126 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:54.611572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0fcf46ea-8c8a-456e-ad83-c3dedc60e126 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1509 microversion: 2.1 time: 0.147157 Jul 25 06:04:54.612158 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 435/862] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:54 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:54.687234 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e5e88c2d-2f0c-42ef-b38f-0a21bf09a11e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:54.687846 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e5e88c2d-2f0c-42ef-b38f-0a21bf09a11e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:54.694532 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5e88c2d-2f0c-42ef-b38f-0a21bf09a11e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:54.694980 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5e88c2d-2f0c-42ef-b38f-0a21bf09a11e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:54.695740 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5e88c2d-2f0c-42ef-b38f-0a21bf09a11e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:54.696205 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e5e88c2d-2f0c-42ef-b38f-0a21bf09a11e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:54.838938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e5e88c2d-2f0c-42ef-b38f-0a21bf09a11e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:54.847504 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e5e88c2d-2f0c-42ef-b38f-0a21bf09a11e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.164119 Jul 25 06:04:54.852301 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 428/863] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:54 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:55.628733 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2c109947-c65b-48fb-945e-4b903bbb9293 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:55.629340 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2c109947-c65b-48fb-945e-4b903bbb9293 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:55.635776 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2c109947-c65b-48fb-945e-4b903bbb9293 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:55.636263 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2c109947-c65b-48fb-945e-4b903bbb9293 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:55.637024 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2c109947-c65b-48fb-945e-4b903bbb9293 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:55.637458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2c109947-c65b-48fb-945e-4b903bbb9293 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:55.765601 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2c109947-c65b-48fb-945e-4b903bbb9293 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:55.773757 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2c109947-c65b-48fb-945e-4b903bbb9293 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1509 microversion: 2.1 time: 0.148885 Jul 25 06:04:55.776442 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 436/864] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:55 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:55.864455 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-49c87869-cf17-4188-a7c5-83abc7929845 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:55.865094 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-49c87869-cf17-4188-a7c5-83abc7929845 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:55.871557 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49c87869-cf17-4188-a7c5-83abc7929845 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:55.872027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49c87869-cf17-4188-a7c5-83abc7929845 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:55.872815 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49c87869-cf17-4188-a7c5-83abc7929845 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:55.873248 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-49c87869-cf17-4188-a7c5-83abc7929845 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:56.024321 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-49c87869-cf17-4188-a7c5-83abc7929845 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:56.034950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-49c87869-cf17-4188-a7c5-83abc7929845 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.173658 Jul 25 06:04:56.047045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 429/865] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:55 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:56.794207 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-34348f3b-a537-462e-a83a-5c66196396f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:56.798145 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-34348f3b-a537-462e-a83a-5c66196396f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:56.808228 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34348f3b-a537-462e-a83a-5c66196396f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:56.808915 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34348f3b-a537-462e-a83a-5c66196396f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:56.809937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34348f3b-a537-462e-a83a-5c66196396f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:56.810441 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34348f3b-a537-462e-a83a-5c66196396f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:56.850369 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-58cff1f0-a700-4e1e-a47d-ea90fe730094 req-4d744491-f7c7-4335-a077-994ba32c7a22 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "ccf69bbe-b5ad-4061-9250-f2f3f0edee2d", "name": "network-vif-deleted", "tag": "de159745-94e2-418c-9c37-533af5667e21"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:56.860382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-58cff1f0-a700-4e1e-a47d-ea90fe730094 req-4d744491-f7c7-4335-a077-994ba32c7a22 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:56.862370 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-58cff1f0-a700-4e1e-a47d-ea90fe730094 req-4d744491-f7c7-4335-a077-994ba32c7a22 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:56.877837 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-58cff1f0-a700-4e1e-a47d-ea90fe730094 req-4d744491-f7c7-4335-a077-994ba32c7a22 service nova] Creating event network-vif-deleted:de159745-94e2-418c-9c37-533af5667e21 for instance ccf69bbe-b5ad-4061-9250-f2f3f0edee2d on hv-cinder-84841 Jul 25 06:04:56.885549 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-58cff1f0-a700-4e1e-a47d-ea90fe730094 req-4d744491-f7c7-4335-a077-994ba32c7a22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038804 Jul 25 06:04:56.886799 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-34348f3b-a537-462e-a83a-5c66196396f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:56.888559 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 430/866] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:56.898561 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-34348f3b-a537-462e-a83a-5c66196396f3 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 200 len: 1467 microversion: 2.1 time: 0.109492 Jul 25 06:04:56.898561 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 437/867] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:56 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 1467 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:57.053476 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-164374d3-a8f1-435f-a30c-d7be6903b5e0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:57.054057 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-164374d3-a8f1-435f-a30c-d7be6903b5e0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:57.060358 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-164374d3-a8f1-435f-a30c-d7be6903b5e0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.060974 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-164374d3-a8f1-435f-a30c-d7be6903b5e0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.061741 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-164374d3-a8f1-435f-a30c-d7be6903b5e0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.062181 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-164374d3-a8f1-435f-a30c-d7be6903b5e0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.214046 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-164374d3-a8f1-435f-a30c-d7be6903b5e0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:57.224341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-164374d3-a8f1-435f-a30c-d7be6903b5e0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.175880 Jul 25 06:04:57.224924 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 431/868] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:57 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:57.361348 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-81e9217e-caff-4f2a-8409-fdc68478052e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f190>>, body: {"volumeAttachment": {"volumeId": "65dbe807-0bad-4170-ab7f-050a145a7bc5"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:04:57.362444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-81e9217e-caff-4f2a-8409-fdc68478052e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:57.368688 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-81e9217e-caff-4f2a-8409-fdc68478052e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.369068 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-81e9217e-caff-4f2a-8409-fdc68478052e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.369822 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-81e9217e-caff-4f2a-8409-fdc68478052e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.370250 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-81e9217e-caff-4f2a-8409-fdc68478052e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.448171 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-81e9217e-caff-4f2a-8409-fdc68478052e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Invalid volume: volume 65dbe807-0bad-4170-ab7f-050a145a7bc5 is already attached to instances: 8fd12755-30ea-4aa4-94ce-e18ed9c29559 Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-81e9217e-caff-4f2a-8409-fdc68478052e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: POST /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments HTTP/1.1 Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 74 Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:04:57.450020 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {"volumeAttachment": {"volumeId": "65dbe807-0bad-4170-ab7f-050a145a7bc5"}} Jul 25 06:04:57.451571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f190>> Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Invalid volume: volume 65dbe807-0bad-4170-ab7f-050a145a7bc5 is already attached to instances: 8fd12755-30ea-4aa4-94ce-e18ed9c29559 Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'server_id': '8fd12755-30ea-4aa4-94ce-e18ed9c29559', 'body': {'volumeAttachment': {'volumeId': '65dbe807-0bad-4170-ab7f-050a145a7bc5'}}} Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 65dbe807-0bad-4170-ab7f-050a145a7bc5 is already attached to instances: 8fd12755-30ea-4aa4-94ce-e18ed9c29559 Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:04:57.452484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 65dbe807-0bad-4170-ab7f-050a145a7bc5 is already attached to instances: 8fd12755-30ea-4aa4-94ce-e18ed9c29559 Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:57.453818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:57.455206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:57.455206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:04:57.455206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:04:57.455206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 65dbe807-0bad-4170-ab7f-050a145a7bc5 is already attached to instances: 8fd12755-30ea-4aa4-94ce-e18ed9c29559 Jul 25 06:04:57.455206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:04:57.455206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-81e9217e-caff-4f2a-8409-fdc68478052e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 400 to user: Invalid volume: volume 65dbe807-0bad-4170-ab7f-050a145a7bc5 is already attached to instances: 8fd12755-30ea-4aa4-94ce-e18ed9c29559 {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:04:57.455206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-81e9217e-caff-4f2a-8409-fdc68478052e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094166 Jul 25 06:04:57.455206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 438/869] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:04:57 2022] POST /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:04:57.512240 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-dfdc0a0d-1ad8-4abf-8f3f-26f7473502a3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4880>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:57.512742 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-dfdc0a0d-1ad8-4abf-8f3f-26f7473502a3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:57.518681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dfdc0a0d-1ad8-4abf-8f3f-26f7473502a3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.519640 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dfdc0a0d-1ad8-4abf-8f3f-26f7473502a3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.520676 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dfdc0a0d-1ad8-4abf-8f3f-26f7473502a3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.521110 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dfdc0a0d-1ad8-4abf-8f3f-26f7473502a3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.603457 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-dfdc0a0d-1ad8-4abf-8f3f-26f7473502a3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lazy-loading 'services' on Instance uuid 8fd12755-30ea-4aa4-94ce-e18ed9c29559 {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:04:57.820645 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-dfdc0a0d-1ad8-4abf-8f3f-26f7473502a3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments/65dbe807-0bad-4170-ab7f-050a145a7bc5" status: 202 len: 0 microversion: 2.1 time: 0.311900 Jul 25 06:04:57.821190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 432/870] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:04:57 2022] DELETE /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments/65dbe807-0bad-4170-ab7f-050a145a7bc5 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:04:57.829327 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-da6a68c9-c644-487c-92d9-196fb084d63c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:57.830314 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-da6a68c9-c644-487c-92d9-196fb084d63c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:57.837640 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-da6a68c9-c644-487c-92d9-196fb084d63c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.838081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-da6a68c9-c644-487c-92d9-196fb084d63c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.838831 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-da6a68c9-c644-487c-92d9-196fb084d63c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.839265 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-da6a68c9-c644-487c-92d9-196fb084d63c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.869140 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-da6a68c9-c644-487c-92d9-196fb084d63c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043535 Jul 25 06:04:57.869697 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 439/871] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:57 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:57.915101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8fbdf700-f2ee-4a1b-a216-efd1c174f7cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:57.915845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8fbdf700-f2ee-4a1b-a216-efd1c174f7cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: ccf69bbe-b5ad-4061-9250-f2f3f0edee2d] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:57.922552 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbdf700-f2ee-4a1b-a216-efd1c174f7cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.923222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbdf700-f2ee-4a1b-a216-efd1c174f7cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.931585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbdf700-f2ee-4a1b-a216-efd1c174f7cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.931585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8fbdf700-f2ee-4a1b-a216-efd1c174f7cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.938465 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-8fbdf700-f2ee-4a1b-a216-efd1c174f7cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] HTTP exception thrown: Instance ccf69bbe-b5ad-4061-9250-f2f3f0edee2d could not be found. Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8fbdf700-f2ee-4a1b-a216-efd1c174f7cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Request method failure captured: Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d HTTP/1.1 Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFNLWQeCYHz8Io1IOt6Hr-lMqJ9K-YweQE3M09yh5R7VR6PG1vMjGfytjWdlaoZHzEo1B_oyLz7Zah8DrhHF8tlpaMtpzBWgxpFZSG7xixeUC3XpV_tpocgpoF3BlRnF2cUrT4CpeLoCBBUGjv0RwbBYMNZ8LqFjtnv-2kVRjdbEIg Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 07562543fa3e40d584b4d4525b112319 Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:04:57.940088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/07562543fa3e40d584b4d4525b112319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07562543fa3e40d584b4d4525b112319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_07562543fa3e40d584b4d4525b112319", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07562543fa3e40d584b4d4525b112319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 07562543fa3e40d584b4d4525b112319 Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-ServerRescueNegativeTestJSON-1718876686-project Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 62e566aa74b045cb8cc6e8edf4a256e1 Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718876686-project Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance ccf69bbe-b5ad-4061-9250-f2f3f0edee2d could not be found. Jul 25 06:04:57.942770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'ccf69bbe-b5ad-4061-9250-f2f3f0edee2d'} Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccf69bbe-b5ad-4061-9250-f2f3f0edee2d could not be found. Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:04:57.944147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccf69bbe-b5ad-4061-9250-f2f3f0edee2d could not be found. Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccf69bbe-b5ad-4061-9250-f2f3f0edee2d could not be found. Jul 25 06:04:57.945429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:04:57.947004 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8fbdf700-f2ee-4a1b-a216-efd1c174f7cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Returning 404 to user: Instance ccf69bbe-b5ad-4061-9250-f2f3f0edee2d could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:04:57.947004 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8fbdf700-f2ee-4a1b-a216-efd1c174f7cb tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d" status: 404 len: 111 microversion: 2.1 time: 0.032095 Jul 25 06:04:57.947004 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 433/872] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:57 2022] GET /compute/v2.1/servers/ccf69bbe-b5ad-4061-9250-f2f3f0edee2d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:04:57.950974 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4f2a02d4-7238-495d-93b8-a4a2d9d4ae50 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:57.951522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4f2a02d4-7238-495d-93b8-a4a2d9d4ae50 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:57.958413 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f2a02d4-7238-495d-93b8-a4a2d9d4ae50 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.958872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f2a02d4-7238-495d-93b8-a4a2d9d4ae50 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.961101 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f2a02d4-7238-495d-93b8-a4a2d9d4ae50 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:57.961101 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4f2a02d4-7238-495d-93b8-a4a2d9d4ae50 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:57.985134 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4f2a02d4-7238-495d-93b8-a4a2d9d4ae50 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:04:58.011728 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:04:58.242296 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f10e58b4-17c3-4e60-a7ee-2e4b8e10d4f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:58.242904 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f10e58b4-17c3-4e60-a7ee-2e4b8e10d4f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:58.248827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f10e58b4-17c3-4e60-a7ee-2e4b8e10d4f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:58.249301 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f10e58b4-17c3-4e60-a7ee-2e4b8e10d4f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:58.250055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f10e58b4-17c3-4e60-a7ee-2e4b8e10d4f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:58.250487 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f10e58b4-17c3-4e60-a7ee-2e4b8e10d4f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:58.297787 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4f2a02d4-7238-495d-93b8-a4a2d9d4ae50 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "DELETE /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 204 len: 0 microversion: 2.1 time: 0.350433 Jul 25 06:04:58.298479 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 440/873] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:04:57 2022] DELETE /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 06:04:58.307960 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-29df3731-dd55-4082-adc9-6c9c4b18fd10 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:58.308689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-29df3731-dd55-4082-adc9-6c9c4b18fd10 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:58.315122 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29df3731-dd55-4082-adc9-6c9c4b18fd10 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:58.315642 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29df3731-dd55-4082-adc9-6c9c4b18fd10 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:58.317328 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29df3731-dd55-4082-adc9-6c9c4b18fd10 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:58.317834 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-29df3731-dd55-4082-adc9-6c9c4b18fd10 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:58.407348 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f10e58b4-17c3-4e60-a7ee-2e4b8e10d4f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:58.417478 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f10e58b4-17c3-4e60-a7ee-2e4b8e10d4f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.179644 Jul 25 06:04:58.418208 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 434/874] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:58 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:58.456901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-29df3731-dd55-4082-adc9-6c9c4b18fd10 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:58.464424 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-29df3731-dd55-4082-adc9-6c9c4b18fd10 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.160445 Jul 25 06:04:58.464991 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 441/875] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:58 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:58.882186 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3c2042e8-0591-4f78-8020-453d9cf0131a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:58.883094 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3c2042e8-0591-4f78-8020-453d9cf0131a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:58.889099 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3c2042e8-0591-4f78-8020-453d9cf0131a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:58.889546 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3c2042e8-0591-4f78-8020-453d9cf0131a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:58.890292 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3c2042e8-0591-4f78-8020-453d9cf0131a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:58.890721 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3c2042e8-0591-4f78-8020-453d9cf0131a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:58.919835 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3c2042e8-0591-4f78-8020-453d9cf0131a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042814 Jul 25 06:04:58.920443 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 435/876] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:58 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:04:59.434834 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f89aa8db-3844-4d3b-92c8-533f42751ed2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:59.435443 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f89aa8db-3844-4d3b-92c8-533f42751ed2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:59.441949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f89aa8db-3844-4d3b-92c8-533f42751ed2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:59.442391 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f89aa8db-3844-4d3b-92c8-533f42751ed2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:59.443145 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f89aa8db-3844-4d3b-92c8-533f42751ed2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:59.443587 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f89aa8db-3844-4d3b-92c8-533f42751ed2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:59.482534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6c6018b5-6c97-46d7-bff5-de056c3ff72a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:59.483172 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6c6018b5-6c97-46d7-bff5-de056c3ff72a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:59.490972 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6c6018b5-6c97-46d7-bff5-de056c3ff72a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:59.491453 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6c6018b5-6c97-46d7-bff5-de056c3ff72a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:59.492246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6c6018b5-6c97-46d7-bff5-de056c3ff72a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:59.498522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6c6018b5-6c97-46d7-bff5-de056c3ff72a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:59.590262 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f89aa8db-3844-4d3b-92c8-533f42751ed2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:59.599234 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f89aa8db-3844-4d3b-92c8-533f42751ed2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.168310 Jul 25 06:04:59.599918 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 442/877] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:59 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:04:59.625190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6c6018b5-6c97-46d7-bff5-de056c3ff72a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:04:59.632730 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6c6018b5-6c97-46d7-bff5-de056c3ff72a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.153925 Jul 25 06:04:59.633222 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 436/878] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:04:59 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:04:59.930961 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9e381028-9b61-44ef-8ee0-ddde586c89ae tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:04:59.931948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9e381028-9b61-44ef-8ee0-ddde586c89ae tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:04:59.937982 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9e381028-9b61-44ef-8ee0-ddde586c89ae tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:59.938433 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9e381028-9b61-44ef-8ee0-ddde586c89ae tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:59.939194 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9e381028-9b61-44ef-8ee0-ddde586c89ae tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:04:59.939633 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9e381028-9b61-44ef-8ee0-ddde586c89ae tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:04:59.968900 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9e381028-9b61-44ef-8ee0-ddde586c89ae tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041967 Jul 25 06:04:59.969448 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 443/879] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:04:59 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:00.617525 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d8b0c27f-bad5-4b0c-ab53-6fd8b531f120 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:00.618093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d8b0c27f-bad5-4b0c-ab53-6fd8b531f120 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:00.624738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d8b0c27f-bad5-4b0c-ab53-6fd8b531f120 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:00.625190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d8b0c27f-bad5-4b0c-ab53-6fd8b531f120 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:00.625969 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d8b0c27f-bad5-4b0c-ab53-6fd8b531f120 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:00.626402 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d8b0c27f-bad5-4b0c-ab53-6fd8b531f120 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:00.649768 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e3d66490-7c4b-46b7-b2ee-c5ed82e1bfd8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:00.650525 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e3d66490-7c4b-46b7-b2ee-c5ed82e1bfd8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:00.657002 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e3d66490-7c4b-46b7-b2ee-c5ed82e1bfd8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:00.657431 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e3d66490-7c4b-46b7-b2ee-c5ed82e1bfd8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:00.658185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e3d66490-7c4b-46b7-b2ee-c5ed82e1bfd8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:00.658612 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e3d66490-7c4b-46b7-b2ee-c5ed82e1bfd8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:00.770795 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d8b0c27f-bad5-4b0c-ab53-6fd8b531f120 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:00.778950 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d8b0c27f-bad5-4b0c-ab53-6fd8b531f120 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.166188 Jul 25 06:05:00.779518 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 437/880] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:00 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:00.797672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-e3d66490-7c4b-46b7-b2ee-c5ed82e1bfd8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:00.805793 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e3d66490-7c4b-46b7-b2ee-c5ed82e1bfd8 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.160179 Jul 25 06:05:00.806356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 444/881] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:00 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:00.980509 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c09c6a50-fc35-44bb-91f1-b98f659607e1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:00.981540 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c09c6a50-fc35-44bb-91f1-b98f659607e1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:00.987673 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c09c6a50-fc35-44bb-91f1-b98f659607e1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:00.988873 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c09c6a50-fc35-44bb-91f1-b98f659607e1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:00.989680 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c09c6a50-fc35-44bb-91f1-b98f659607e1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:00.990121 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c09c6a50-fc35-44bb-91f1-b98f659607e1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:01.018557 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c09c6a50-fc35-44bb-91f1-b98f659607e1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042060 Jul 25 06:05:01.019150 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 438/882] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:00 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:01.796981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4542ace9-cdaa-4528-b377-9277f2546fea tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:01.797731 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4542ace9-cdaa-4528-b377-9277f2546fea tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:01.806218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4542ace9-cdaa-4528-b377-9277f2546fea tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:01.806754 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4542ace9-cdaa-4528-b377-9277f2546fea tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:01.807639 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4542ace9-cdaa-4528-b377-9277f2546fea tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:01.808161 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4542ace9-cdaa-4528-b377-9277f2546fea tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:01.824976 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f85775c0-7f45-43b7-a8fa-e60603073caf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:01.826396 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f85775c0-7f45-43b7-a8fa-e60603073caf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:01.835205 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f85775c0-7f45-43b7-a8fa-e60603073caf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:01.836033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f85775c0-7f45-43b7-a8fa-e60603073caf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:01.837250 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f85775c0-7f45-43b7-a8fa-e60603073caf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:01.837909 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f85775c0-7f45-43b7-a8fa-e60603073caf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:01.982842 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f85775c0-7f45-43b7-a8fa-e60603073caf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:01.991357 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f85775c0-7f45-43b7-a8fa-e60603073caf tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1521 microversion: 2.1 time: 0.171121 Jul 25 06:05:01.991863 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 439/883] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:01 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:02.031225 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3ca6c3fb-d2ae-4a40-a3d3-bc08460a17f9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:02.032407 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3ca6c3fb-d2ae-4a40-a3d3-bc08460a17f9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:02.039032 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ca6c3fb-d2ae-4a40-a3d3-bc08460a17f9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:02.039537 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ca6c3fb-d2ae-4a40-a3d3-bc08460a17f9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:02.040359 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ca6c3fb-d2ae-4a40-a3d3-bc08460a17f9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:02.040791 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3ca6c3fb-d2ae-4a40-a3d3-bc08460a17f9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:02.071554 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3ca6c3fb-d2ae-4a40-a3d3-bc08460a17f9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044340 Jul 25 06:05:02.072149 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 440/884] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:02 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 06:05:02.080701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4542ace9-cdaa-4528-b377-9277f2546fea tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:02.097729 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4542ace9-cdaa-4528-b377-9277f2546fea tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1755 microversion: 2.1 time: 0.304343 Jul 25 06:05:02.108300 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 445/885] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:01 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1755 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:02.137121 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-69c1e684-31b5-4a10-ab7e-84ad24020f38 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:02.137624 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-69c1e684-31b5-4a10-ab7e-84ad24020f38 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:02.144164 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-69c1e684-31b5-4a10-ab7e-84ad24020f38 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:02.144625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-69c1e684-31b5-4a10-ab7e-84ad24020f38 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:02.145408 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-69c1e684-31b5-4a10-ab7e-84ad24020f38 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:02.145844 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-69c1e684-31b5-4a10-ab7e-84ad24020f38 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:02.172339 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-69c1e684-31b5-4a10-ab7e-84ad24020f38 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Going to try to terminate instance {{(pid=124917) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:05:02.200841 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:02.400708 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-a9512262-f8e9-4c82-8dd9-6b802b1391c5 req-cc446ed0-f6c7-49a5-abdb-4442d0b59ef6 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf", "name": "network-vif-deleted", "tag": "07e8aaba-4e29-4898-865b-3e4e9f738a49"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:02.408656 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-a9512262-f8e9-4c82-8dd9-6b802b1391c5 req-cc446ed0-f6c7-49a5-abdb-4442d0b59ef6 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:02.409090 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-a9512262-f8e9-4c82-8dd9-6b802b1391c5 req-cc446ed0-f6c7-49a5-abdb-4442d0b59ef6 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:02.420599 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-a9512262-f8e9-4c82-8dd9-6b802b1391c5 req-cc446ed0-f6c7-49a5-abdb-4442d0b59ef6 service nova] Creating event network-vif-deleted:07e8aaba-4e29-4898-865b-3e4e9f738a49 for instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf on hv-cinder-84841 Jul 25 06:05:02.425383 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-a9512262-f8e9-4c82-8dd9-6b802b1391c5 req-cc446ed0-f6c7-49a5-abdb-4442d0b59ef6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028654 Jul 25 06:05:02.426703 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 446/886] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:02.434821 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-69c1e684-31b5-4a10-ab7e-84ad24020f38 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 204 len: 0 microversion: 2.1 time: 0.301290 Jul 25 06:05:02.435397 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 441/887] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:05:02 2022] DELETE /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:05:02.444196 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-df5a1f54-c754-4edf-86e7-8b67c50114d9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:02.444896 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-df5a1f54-c754-4edf-86e7-8b67c50114d9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:02.450997 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-df5a1f54-c754-4edf-86e7-8b67c50114d9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:02.451446 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-df5a1f54-c754-4edf-86e7-8b67c50114d9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:02.456420 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-df5a1f54-c754-4edf-86e7-8b67c50114d9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:02.456420 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-df5a1f54-c754-4edf-86e7-8b67c50114d9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:02.588394 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-df5a1f54-c754-4edf-86e7-8b67c50114d9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:02.595764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-df5a1f54-c754-4edf-86e7-8b67c50114d9 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1681 microversion: 2.1 time: 0.156065 Jul 25 06:05:02.596353 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 447/888] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:02 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:03.009474 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-fbbb2c33-03c3-43cd-acfa-9f5cb30ac25c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:03.010120 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-fbbb2c33-03c3-43cd-acfa-9f5cb30ac25c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:03.016637 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fbbb2c33-03c3-43cd-acfa-9f5cb30ac25c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.017079 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fbbb2c33-03c3-43cd-acfa-9f5cb30ac25c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.017898 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fbbb2c33-03c3-43cd-acfa-9f5cb30ac25c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.018324 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fbbb2c33-03c3-43cd-acfa-9f5cb30ac25c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.081396 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-fbbb2c33-03c3-43cd-acfa-9f5cb30ac25c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:03.089128 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-fbbb2c33-03c3-43cd-acfa-9f5cb30ac25c tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1306 microversion: 2.1 time: 0.084042 Jul 25 06:05:03.089677 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 442/889] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:03 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1306 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:03.116654 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ba89da78-f38e-42fa-ac2a-0f0d5282bc22 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:03.117256 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ba89da78-f38e-42fa-ac2a-0f0d5282bc22 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:03.123727 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ba89da78-f38e-42fa-ac2a-0f0d5282bc22 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.124205 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ba89da78-f38e-42fa-ac2a-0f0d5282bc22 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.124963 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ba89da78-f38e-42fa-ac2a-0f0d5282bc22 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.125391 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ba89da78-f38e-42fa-ac2a-0f0d5282bc22 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.270345 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ba89da78-f38e-42fa-ac2a-0f0d5282bc22 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:03.278696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ba89da78-f38e-42fa-ac2a-0f0d5282bc22 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1758 microversion: 2.1 time: 0.167966 Jul 25 06:05:03.279373 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 448/890] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:03 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:03.614233 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a742fb13-e4a9-46d4-8435-3a2e3b88ac04 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:03.614811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-a742fb13-e4a9-46d4-8435-3a2e3b88ac04 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:03.620939 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a742fb13-e4a9-46d4-8435-3a2e3b88ac04 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.621386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a742fb13-e4a9-46d4-8435-3a2e3b88ac04 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.622143 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a742fb13-e4a9-46d4-8435-3a2e3b88ac04 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:03.622581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a742fb13-e4a9-46d4-8435-3a2e3b88ac04 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:03.755791 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a742fb13-e4a9-46d4-8435-3a2e3b88ac04 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:03.763321 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a742fb13-e4a9-46d4-8435-3a2e3b88ac04 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1681 microversion: 2.1 time: 0.153372 Jul 25 06:05:03.763876 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 443/891] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:03 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:04.106847 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-785704a8-d73c-41b7-be72-1250c6f74cc1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:04.107451 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-785704a8-d73c-41b7-be72-1250c6f74cc1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:04.115351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-785704a8-d73c-41b7-be72-1250c6f74cc1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:04.115793 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-785704a8-d73c-41b7-be72-1250c6f74cc1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:04.116583 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-785704a8-d73c-41b7-be72-1250c6f74cc1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:04.117013 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-785704a8-d73c-41b7-be72-1250c6f74cc1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:04.180820 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-785704a8-d73c-41b7-be72-1250c6f74cc1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62e566aa74b045cb8cc6e8edf4a256e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07562543fa3e40d584b4d4525b112319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:04.189229 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-785704a8-d73c-41b7-be72-1250c6f74cc1 tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 200 len: 1306 microversion: 2.1 time: 0.086189 Jul 25 06:05:04.192707 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 449/892] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:04 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 1306 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:04.781626 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-455ffa5a-1bbe-4cc2-8980-a8aab7608e9c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:04.782245 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-455ffa5a-1bbe-4cc2-8980-a8aab7608e9c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:04.789815 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-455ffa5a-1bbe-4cc2-8980-a8aab7608e9c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:04.790273 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-455ffa5a-1bbe-4cc2-8980-a8aab7608e9c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:04.791040 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-455ffa5a-1bbe-4cc2-8980-a8aab7608e9c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:04.791479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-455ffa5a-1bbe-4cc2-8980-a8aab7608e9c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:04.932259 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-455ffa5a-1bbe-4cc2-8980-a8aab7608e9c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:04.939747 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-455ffa5a-1bbe-4cc2-8980-a8aab7608e9c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1681 microversion: 2.1 time: 0.162129 Jul 25 06:05:04.940338 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 444/893] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:04 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:05.205677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7b65d6b4-dc4b-409e-b0e7-e7bf18e6685a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:05.206291 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7b65d6b4-dc4b-409e-b0e7-e7bf18e6685a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] [instance: 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:05.213815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b65d6b4-dc4b-409e-b0e7-e7bf18e6685a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:05.214248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b65d6b4-dc4b-409e-b0e7-e7bf18e6685a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:05.215046 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b65d6b4-dc4b-409e-b0e7-e7bf18e6685a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:05.215661 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b65d6b4-dc4b-409e-b0e7-e7bf18e6685a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:05.229187 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-7b65d6b4-dc4b-409e-b0e7-e7bf18e6685a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] HTTP exception thrown: Instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf could not be found. Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7b65d6b4-dc4b-409e-b0e7-e7bf18e6685a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Request method failure captured: Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf HTTP/1.1 Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFNLWQeCYHz8Io1IOt6Hr-lMqJ9K-YweQE3M09yh5R7VR6PG1vMjGfytjWdlaoZHzEo1B_oyLz7Zah8DrhHF8tlpaMtpzBWgxpFZSG7xixeUC3XpV_tpocgpoF3BlRnF2cUrT4CpeLoCBBUGjv0RwbBYMNZ8LqFjtnv-2kVRjdbEIg Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: 07562543fa3e40d584b4d4525b112319 Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:05:05.230844 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/07562543fa3e40d584b4d4525b112319"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07562543fa3e40d584b4d4525b112319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_07562543fa3e40d584b4d4525b112319", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/07562543fa3e40d584b4d4525b112319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: 07562543fa3e40d584b4d4525b112319 Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718876686 Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-ServerRescueNegativeTestJSON-1718876686-project Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 62e566aa74b045cb8cc6e8edf4a256e1 Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718876686-project Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf could not be found. Jul 25 06:05:05.232497 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': '3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf'} Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf could not be found. Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:05.233568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf could not be found. Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf could not be found. Jul 25 06:05:05.234811 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:05:05.235995 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7b65d6b4-dc4b-409e-b0e7-e7bf18e6685a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] Returning 404 to user: Instance 3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:05.235995 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7b65d6b4-dc4b-409e-b0e7-e7bf18e6685a tempest-ServerRescueNegativeTestJSON-1718876686 tempest-ServerRescueNegativeTestJSON-1718876686-project] 10.222.0.40 "GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf" status: 404 len: 111 microversion: 2.1 time: 0.030405 Jul 25 06:05:05.235995 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 450/894] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:05 2022] GET /compute/v2.1/servers/3a12c8a0-efcb-4d3c-99e8-c11fb39eb7cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:05.539946 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-d5b3b7b0-255a-49ee-9438-5c56e2ee27c1 req-f525c93b-5efb-4c9e-af79-2805e5abdd5b service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "8fd12755-30ea-4aa4-94ce-e18ed9c29559", "name": "network-vif-deleted", "tag": "6e112229-0732-4652-b953-cf6548e850ee"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:05.548766 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-d5b3b7b0-255a-49ee-9438-5c56e2ee27c1 req-f525c93b-5efb-4c9e-af79-2805e5abdd5b service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:05.549638 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-d5b3b7b0-255a-49ee-9438-5c56e2ee27c1 req-f525c93b-5efb-4c9e-af79-2805e5abdd5b service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:05.562280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-d5b3b7b0-255a-49ee-9438-5c56e2ee27c1 req-f525c93b-5efb-4c9e-af79-2805e5abdd5b service nova] Creating event network-vif-deleted:6e112229-0732-4652-b953-cf6548e850ee for instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 on hv-cinder-84841 Jul 25 06:05:05.568213 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-d5b3b7b0-255a-49ee-9438-5c56e2ee27c1 req-f525c93b-5efb-4c9e-af79-2805e5abdd5b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095069 Jul 25 06:05:05.569117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 445/895] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:05.957346 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5f598b3b-a72c-4d5b-bf62-8ba76de1d81b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:05.957986 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5f598b3b-a72c-4d5b-bf62-8ba76de1d81b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:05.965240 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f598b3b-a72c-4d5b-bf62-8ba76de1d81b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:05.965681 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f598b3b-a72c-4d5b-bf62-8ba76de1d81b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:05.966585 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f598b3b-a72c-4d5b-bf62-8ba76de1d81b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:05.966942 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f598b3b-a72c-4d5b-bf62-8ba76de1d81b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:06.005709 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f598b3b-a72c-4d5b-bf62-8ba76de1d81b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:06.006700 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5f598b3b-a72c-4d5b-bf62-8ba76de1d81b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:06.007421 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-5f598b3b-a72c-4d5b-bf62-8ba76de1d81b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lazy-loading 'fault' on Instance uuid 8fd12755-30ea-4aa4-94ce-e18ed9c29559 {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:05:06.057690 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5f598b3b-a72c-4d5b-bf62-8ba76de1d81b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:06.068851 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5f598b3b-a72c-4d5b-bf62-8ba76de1d81b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 200 len: 1330 microversion: 2.1 time: 0.115620 Jul 25 06:05:06.070129 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 451/896] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:05 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:07.088306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0e3aee6b-d929-40f6-bbce-488648b68477 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:07.089642 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0e3aee6b-d929-40f6-bbce-488648b68477 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:07.096005 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0e3aee6b-d929-40f6-bbce-488648b68477 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:07.096483 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0e3aee6b-d929-40f6-bbce-488648b68477 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:07.097943 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0e3aee6b-d929-40f6-bbce-488648b68477 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:07.098617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0e3aee6b-d929-40f6-bbce-488648b68477 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:07.112277 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-0e3aee6b-d929-40f6-bbce-488648b68477 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0e3aee6b-d929-40f6-bbce-488648b68477 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 HTTP/1.1 Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:05:07.114126 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:05:07.115460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': '8fd12755-30ea-4aa4-94ce-e18ed9c29559'} Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:07.116337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:05:07.117586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:07.118687 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0e3aee6b-d929-40f6-bbce-488648b68477 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:07.118687 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0e3aee6b-d929-40f6-bbce-488648b68477 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 404 len: 111 microversion: 2.1 time: 0.032164 Jul 25 06:05:07.118687 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 446/897] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:07 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:07.128050 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d4d846d1-a7cf-4225-b1ff-6c8e787230bf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531c88790>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:07.199204 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d4d846d1-a7cf-4225-b1ff-6c8e787230bf tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-97086995" status: 202 len: 0 microversion: 2.1 time: 0.075067 Jul 25 06:05:07.199785 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 452/898] 10.222.0.40 () {58 vars in 1214 bytes} [Mon Jul 25 06:05:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-97086995 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:05:08.071201 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-196edc91-cf3b-4834-800b-c69296beb479 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6531c78b80>, body: {"keypair": {"name": "tempest-keypair-1129060592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUKMJJ1w0OZfZ4qPiif+8YBmpUSBJ+vkfbgTOPQ9DESgp9as+TZLmR6LP0YYKB088MvcZ+9eDEbMQWZFdzqA38ST1KuUFJBlP7u4yPbCwhPMkUUUHOnTwnDT6MQLOq7tw=="}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:08.085585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-196edc91-cf3b-4834-800b-c69296beb479 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'key_pairs'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:05:08.089395 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-196edc91-cf3b-4834-800b-c69296beb479 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for user 8eedefd8d94047478663ceab8962d738 and project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'key_pairs'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:05:08.177048 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-196edc91-cf3b-4834-800b-c69296beb479 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110620 Jul 25 06:05:08.177656 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 447/899] 10.222.0.40 () {60 vars in 1158 bytes} [Mon Jul 25 06:05:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:10.522008 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5c4c0>>, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1042014449", "imageRef": "289cf141-3996-46ba-969d-6cfa9efecae0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d80cb7ca-3031-41c9-afe8-b6a4faf27141"}], "security_groups": [{"name": "tempest-securitygroup--1588955345"}], "key_name": "tempest-keypair-1129060592", "user_data": "}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:10.630593 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.network.neutron [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] validate_networks() for [('d80cb7ca-3031-41c9-afe8-b6a4faf27141', None, None, None, None, None)] {{(pid=124918) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:05:10.970881 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9bd6b77f-a558-4fe1-bccd-e942a357a920 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6531b0a820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-555903422", "metadata": {"Type": "work"}}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:11.123915 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Flavor limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:05:11.124401 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Image limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:05:11.124875 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Flavor pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:05:11.125283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Image pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:05:11.125714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:05:11.135002 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:11.135449 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:11.136319 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:11.136765 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:11.154346 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:05:11.158520 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Getting quotas for user 8eedefd8d94047478663ceab8962d738 and project a6fd13a3dd1d4e2b83cf6e44160adf35. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:05:11.170457 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Going to run 1 instances... {{(pid=124918) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:05:11.172816 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=<?>,image_id='289cf141-3996-46ba-969d-6cfa9efecae0',instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=<?>,uuid=<?>,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:05:11.427831 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-55fe4971-33cc-4ec6-beeb-b1c68e63d729 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.913745 Jul 25 06:05:11.428513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 453/900] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:05:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 06:05:11.438219 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a4a67c55-a932-4cb7-8ef9-942063aa660f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:11.438821 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a4a67c55-a932-4cb7-8ef9-942063aa660f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:11.495085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a4a67c55-a932-4cb7-8ef9-942063aa660f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:11.655825 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a4a67c55-a932-4cb7-8ef9-942063aa660f tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1242 microversion: 2.1 time: 0.221329 Jul 25 06:05:11.656502 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 454/901] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:11 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:11.791257 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9bd6b77f-a558-4fe1-bccd-e942a357a920 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.935838 Jul 25 06:05:11.791880 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 448/902] 10.222.0.40 () {60 vars in 1155 bytes} [Mon Jul 25 06:05:10 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 937 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 25 06:05:11.803276 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1ee6dd59-9504-4eea-8d8f-be1d77d16915 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531cb6430>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:11.851672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1ee6dd59-9504-4eea-8d8f-be1d77d16915 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe" status: 200 len: 352 microversion: 2.1 time: 0.052491 Jul 25 06:05:11.852195 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 455/903] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 06:05:11 2022] GET /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:12.673379 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-62a0493b-4f5f-4791-bd28-409f49f7f3eb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:12.673975 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-62a0493b-4f5f-4791-bd28-409f49f7f3eb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:12.680189 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-62a0493b-4f5f-4791-bd28-409f49f7f3eb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:12.680634 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-62a0493b-4f5f-4791-bd28-409f49f7f3eb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:12.681388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-62a0493b-4f5f-4791-bd28-409f49f7f3eb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:12.681820 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-62a0493b-4f5f-4791-bd28-409f49f7f3eb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:12.746223 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-62a0493b-4f5f-4791-bd28-409f49f7f3eb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:12.753615 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-62a0493b-4f5f-4791-bd28-409f49f7f3eb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1246 microversion: 2.1 time: 0.084571 Jul 25 06:05:12.754173 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 449/904] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:12 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:12.864647 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-92d42f2d-c74d-4388-8926-0913625a5b6e tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531d01670>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:12.911829 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-92d42f2d-c74d-4388-8926-0913625a5b6e tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe" status: 200 len: 353 microversion: 2.1 time: 0.051441 Jul 25 06:05:12.912422 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 456/905] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 06:05:12 2022] GET /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:12.929537 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1b8d9e88-1b5f-48ad-ae6f-157313d50a73 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531b86940>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:12.977606 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1b8d9e88-1b5f-48ad-ae6f-157313d50a73 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe" status: 200 len: 353 microversion: 2.1 time: 0.051677 Jul 25 06:05:12.978181 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 450/906] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 06:05:12 2022] GET /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:12.995269 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4aa822b7-f546-45ee-a0e1-28b27dba1e32 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531d01700>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:13.202949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4aa822b7-f546-45ee-a0e1-28b27dba1e32 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe" status: 202 len: 0 microversion: 2.1 time: 0.212264 Jul 25 06:05:13.203508 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 457/907] 10.222.0.40 () {58 vars in 1247 bytes} [Mon Jul 25 06:05:12 2022] DELETE /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:05:13.212037 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-108b6efc-6274-4f27-b6a8-71df5802d9e0 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531b0adc0>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:13.258050 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-108b6efc-6274-4f27-b6a8-71df5802d9e0 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe" status: 200 len: 352 microversion: 2.1 time: 0.050416 Jul 25 06:05:13.258614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 451/908] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 06:05:13 2022] GET /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:13.771955 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-95bad97a-43e3-4b7d-a64b-5a662830c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:13.773746 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-95bad97a-43e3-4b7d-a64b-5a662830c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:13.780567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95bad97a-43e3-4b7d-a64b-5a662830c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:13.780567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95bad97a-43e3-4b7d-a64b-5a662830c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:13.781327 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95bad97a-43e3-4b7d-a64b-5a662830c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:13.781758 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-95bad97a-43e3-4b7d-a64b-5a662830c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:13.853737 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-95bad97a-43e3-4b7d-a64b-5a662830c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:13.861206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-95bad97a-43e3-4b7d-a64b-5a662830c5c1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1312 microversion: 2.1 time: 0.094066 Jul 25 06:05:13.861771 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 458/909] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:13 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:14.271112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7a7b0449-315a-4ae5-8f1e-2f52584919c9 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531ae6d30>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:14.299470 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-7a7b0449-315a-4ae5-8f1e-2f52584919c9 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] HTTP exception thrown: Volume 41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe could not be found. Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7a7b0449-315a-4ae5-8f1e-2f52584919c9 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] Request method failure captured: Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe HTTP/1.1 Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jKWdEz15xmKFHlEKfeTubpsJnqi5Jm5rBABH7K4q-6-r1BAsee_LwFGZKhxxL6eE-TcfNCk4UGVpEkGzA2ebBl3sdobbWg7Px6uyagP7LugpguAFJGILWOamznpGK0H9MUs8sxSTAB_oEKNstv-eLV7LDkHxfrpw7xsjdR6iWgHByY Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 8f06daf80ee3411ea26303b19e764337 Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-VolumesGetTestJSON-122608453 Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:05:14.301461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8f06daf80ee3411ea26303b19e764337"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8f06daf80ee3411ea26303b19e764337"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8f06daf80ee3411ea26303b19e764337", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8f06daf80ee3411ea26303b19e764337"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-VolumesGetTestJSON-122608453 Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 8f06daf80ee3411ea26303b19e764337 Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-VolumesGetTestJSON-122608453 Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-VolumesGetTestJSON-122608453-project Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: ce4e96ab759148f3859c9f9d55ab8672 Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-VolumesGetTestJSON-122608453-project Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <function VolumeController.show at 0x7f6531ae6d30> Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Volume 41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe could not be found. Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': '41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe'} Jul 25 06:05:14.305762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe could not be found. (HTTP 404) (Request-ID: req-54478efa-554e-4cec-9788-12e20bf5febc) Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:14.306646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 06:05:14.307937 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe could not be found. Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 06:05:14.309114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe could not be found. Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe could not be found. Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7a7b0449-315a-4ae5-8f1e-2f52584919c9 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] Returning 404 to user: Volume 41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7a7b0449-315a-4ae5-8f1e-2f52584919c9 tempest-VolumesGetTestJSON-122608453 tempest-VolumesGetTestJSON-122608453-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe" status: 404 len: 109 microversion: 2.1 time: 0.037045 Jul 25 06:05:14.310280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 452/910] 10.222.0.40 () {58 vars in 1244 bytes} [Mon Jul 25 06:05:14 2022] GET /compute/v2.1/os-volumes/41c9d4c0-7c3f-4ef8-ac34-d1e14227e8fe => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:14.878465 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-265cdda7-2d11-4894-9a28-5bc4bcea491d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:14.879061 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-265cdda7-2d11-4894-9a28-5bc4bcea491d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:14.885992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-265cdda7-2d11-4894-9a28-5bc4bcea491d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:14.886444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-265cdda7-2d11-4894-9a28-5bc4bcea491d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:14.887216 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-265cdda7-2d11-4894-9a28-5bc4bcea491d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:14.887828 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-265cdda7-2d11-4894-9a28-5bc4bcea491d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.187547 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-265cdda7-2d11-4894-9a28-5bc4bcea491d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:15.197095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-265cdda7-2d11-4894-9a28-5bc4bcea491d tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1368 microversion: 2.1 time: 0.322020 Jul 25 06:05:15.197542 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 459/911] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:14 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1368 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:15.674848 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-16c9516d-215d-42fe-9b72-bd233990afe9 req-804acb73-da71-4d6c-863b-54e47af9c03e service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "d21512fe-e078-4674-bb50-659aeebf1a6b", "tag": "7da6481b-18b6-48f5-aaff-0f86837cc82a"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:15.687629 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-16c9516d-215d-42fe-9b72-bd233990afe9 req-804acb73-da71-4d6c-863b-54e47af9c03e service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:15.689191 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-16c9516d-215d-42fe-9b72-bd233990afe9 req-804acb73-da71-4d6c-863b-54e47af9c03e service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:15.704312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-16c9516d-215d-42fe-9b72-bd233990afe9 req-804acb73-da71-4d6c-863b-54e47af9c03e service nova] Creating event network-changed:7da6481b-18b6-48f5-aaff-0f86837cc82a for instance d21512fe-e078-4674-bb50-659aeebf1a6b on hv-cinder-84841 Jul 25 06:05:15.709556 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-16c9516d-215d-42fe-9b72-bd233990afe9 req-804acb73-da71-4d6c-863b-54e47af9c03e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045490 Jul 25 06:05:15.710422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 453/912] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:16.214483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4568f5e5-dca8-4398-9f03-58db55393005 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:16.215179 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4568f5e5-dca8-4398-9f03-58db55393005 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:16.217581 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:16.222682 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4568f5e5-dca8-4398-9f03-58db55393005 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:16.223184 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4568f5e5-dca8-4398-9f03-58db55393005 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:16.224030 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4568f5e5-dca8-4398-9f03-58db55393005 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:16.224527 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4568f5e5-dca8-4398-9f03-58db55393005 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:16.450263 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4568f5e5-dca8-4398-9f03-58db55393005 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:16.457881 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4568f5e5-dca8-4398-9f03-58db55393005 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1368 microversion: 2.1 time: 0.247374 Jul 25 06:05:16.458725 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 460/913] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:16 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:17.475623 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e3dc34fc-4acb-45f0-b078-a86c8464857b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:17.476272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e3dc34fc-4acb-45f0-b078-a86c8464857b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:17.482788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e3dc34fc-4acb-45f0-b078-a86c8464857b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:17.483012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e3dc34fc-4acb-45f0-b078-a86c8464857b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:17.483820 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e3dc34fc-4acb-45f0-b078-a86c8464857b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:17.484565 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e3dc34fc-4acb-45f0-b078-a86c8464857b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:17.621628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e3dc34fc-4acb-45f0-b078-a86c8464857b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:17.626993 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e3dc34fc-4acb-45f0-b078-a86c8464857b tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1368 microversion: 2.1 time: 0.156387 Jul 25 06:05:17.627588 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 454/914] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:17 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:18.644397 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-48096830-b107-460c-a289-bc278a9973ce tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:18.645062 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-48096830-b107-460c-a289-bc278a9973ce tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:18.652424 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-48096830-b107-460c-a289-bc278a9973ce tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:18.652864 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-48096830-b107-460c-a289-bc278a9973ce tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:18.653621 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-48096830-b107-460c-a289-bc278a9973ce tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:18.654046 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-48096830-b107-460c-a289-bc278a9973ce tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:18.783453 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-48096830-b107-460c-a289-bc278a9973ce tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:18.790974 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-48096830-b107-460c-a289-bc278a9973ce tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1368 microversion: 2.1 time: 0.150545 Jul 25 06:05:18.791520 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 461/915] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:18 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:19.807762 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e6efc1da-3eb6-4df3-aa27-fdab1fef2db2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:19.808568 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e6efc1da-3eb6-4df3-aa27-fdab1fef2db2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:19.810404 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=4 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:19.811540 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:19.816478 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e6efc1da-3eb6-4df3-aa27-fdab1fef2db2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:19.816928 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e6efc1da-3eb6-4df3-aa27-fdab1fef2db2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:19.817718 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e6efc1da-3eb6-4df3-aa27-fdab1fef2db2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:19.818153 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e6efc1da-3eb6-4df3-aa27-fdab1fef2db2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:20.108380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e6efc1da-3eb6-4df3-aa27-fdab1fef2db2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:20.117119 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e6efc1da-3eb6-4df3-aa27-fdab1fef2db2 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1368 microversion: 2.1 time: 0.313204 Jul 25 06:05:20.117682 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 455/916] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:19 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:20.248948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0f1b0a3f-c51c-49ae-b449-584a196be3a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method IPsController.index of <nova.api.openstack.compute.ips.IPsController object at 0x7f6533ee6fa0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:20.249458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-0f1b0a3f-c51c-49ae-b449-584a196be3a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:20.255576 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0f1b0a3f-c51c-49ae-b449-584a196be3a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:20.262186 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0f1b0a3f-c51c-49ae-b449-584a196be3a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:20.262186 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0f1b0a3f-c51c-49ae-b449-584a196be3a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:20.262186 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0f1b0a3f-c51c-49ae-b449-584a196be3a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:20.280329 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0f1b0a3f-c51c-49ae-b449-584a196be3a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/ips" status: 200 len: 151 microversion: 2.20 time: 0.199277 Jul 25 06:05:20.280898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 462/917] 10.222.0.40 () {60 vars in 1288 bytes} [Mon Jul 25 06:05:20 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/ips => generated 151 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 06:05:21.135255 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-731629a5-13ab-4851-97e0-baa74a26bd0a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:21.135865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-731629a5-13ab-4851-97e0-baa74a26bd0a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:21.142374 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-731629a5-13ab-4851-97e0-baa74a26bd0a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:21.142828 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-731629a5-13ab-4851-97e0-baa74a26bd0a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:21.143581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-731629a5-13ab-4851-97e0-baa74a26bd0a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:21.144045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-731629a5-13ab-4851-97e0-baa74a26bd0a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:21.277856 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-731629a5-13ab-4851-97e0-baa74a26bd0a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:21.285129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-731629a5-13ab-4851-97e0-baa74a26bd0a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1368 microversion: 2.1 time: 0.154241 Jul 25 06:05:21.285679 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 456/918] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:21 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:22.303041 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3cd0e5c2-e611-4b84-b8c8-92be65585f83 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:22.303645 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3cd0e5c2-e611-4b84-b8c8-92be65585f83 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:22.305955 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:22.306659 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=8 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:22.311375 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3cd0e5c2-e611-4b84-b8c8-92be65585f83 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:22.311866 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3cd0e5c2-e611-4b84-b8c8-92be65585f83 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:22.312645 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3cd0e5c2-e611-4b84-b8c8-92be65585f83 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:22.313074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3cd0e5c2-e611-4b84-b8c8-92be65585f83 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:22.333249 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:22.448199 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3cd0e5c2-e611-4b84-b8c8-92be65585f83 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:22.455488 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3cd0e5c2-e611-4b84-b8c8-92be65585f83 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1368 microversion: 2.1 time: 0.156821 Jul 25 06:05:22.456037 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 463/919] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:22 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:23.472195 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d3ff731c-a636-4d69-b5c6-cc71aa851adc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:23.472906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d3ff731c-a636-4d69-b5c6-cc71aa851adc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:23.479446 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d3ff731c-a636-4d69-b5c6-cc71aa851adc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:23.479898 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d3ff731c-a636-4d69-b5c6-cc71aa851adc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:23.480669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d3ff731c-a636-4d69-b5c6-cc71aa851adc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:23.481101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d3ff731c-a636-4d69-b5c6-cc71aa851adc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:23.607885 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d3ff731c-a636-4d69-b5c6-cc71aa851adc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:23.615965 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d3ff731c-a636-4d69-b5c6-cc71aa851adc tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1368 microversion: 2.1 time: 0.147575 Jul 25 06:05:23.616540 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 457/920] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:23 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:24.531778 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-62de8ca2-9420-46d9-bc05-76eacbf53cf2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Action: 'action', calling method: <bound method ShelveController._shelve of <nova.api.openstack.compute.shelve.ShelveController object at 0x7f6533edda60>>, body: {"shelve": {}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:24.532367 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-62de8ca2-9420-46d9-bc05-76eacbf53cf2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:24.539712 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-62de8ca2-9420-46d9-bc05-76eacbf53cf2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:24.540178 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-62de8ca2-9420-46d9-bc05-76eacbf53cf2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:24.541029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-62de8ca2-9420-46d9-bc05-76eacbf53cf2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:24.541456 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-62de8ca2-9420-46d9-bc05-76eacbf53cf2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:24.563311 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-62de8ca2-9420-46d9-bc05-76eacbf53cf2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lazy-loading 'flavor' on Instance uuid 5e834f53-fb25-48ed-a03c-33717c1e39ff {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:05:24.632619 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-04eb529f-e424-4d6d-9c9c-3b79f634fb50 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:24.633388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-04eb529f-e424-4d6d-9c9c-3b79f634fb50 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:24.639859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-04eb529f-e424-4d6d-9c9c-3b79f634fb50 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:24.640341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-04eb529f-e424-4d6d-9c9c-3b79f634fb50 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:24.641099 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-04eb529f-e424-4d6d-9c9c-3b79f634fb50 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:24.641533 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-04eb529f-e424-4d6d-9c9c-3b79f634fb50 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:24.777882 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-04eb529f-e424-4d6d-9c9c-3b79f634fb50 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:24.785549 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-04eb529f-e424-4d6d-9c9c-3b79f634fb50 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1368 microversion: 2.1 time: 0.156888 Jul 25 06:05:24.786117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 458/921] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:24 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:05:25.013224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-f6d6b12a-dde5-4cb2-aa40-11e1d1d0a0cf req-bc98fee3-0cf0-466b-bfb5-ddeb0e97078b service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "d21512fe-e078-4674-bb50-659aeebf1a6b", "name": "network-vif-plugged", "status": "completed", "tag": "7da6481b-18b6-48f5-aaff-0f86837cc82a"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:25.022382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-f6d6b12a-dde5-4cb2-aa40-11e1d1d0a0cf req-bc98fee3-0cf0-466b-bfb5-ddeb0e97078b service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.022824 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-f6d6b12a-dde5-4cb2-aa40-11e1d1d0a0cf req-bc98fee3-0cf0-466b-bfb5-ddeb0e97078b service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.035456 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-f6d6b12a-dde5-4cb2-aa40-11e1d1d0a0cf req-bc98fee3-0cf0-466b-bfb5-ddeb0e97078b service nova] Creating event network-vif-plugged:7da6481b-18b6-48f5-aaff-0f86837cc82a for instance d21512fe-e078-4674-bb50-659aeebf1a6b on hv-cinder-84841 Jul 25 06:05:25.040712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-f6d6b12a-dde5-4cb2-aa40-11e1d1d0a0cf req-bc98fee3-0cf0-466b-bfb5-ddeb0e97078b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096320 Jul 25 06:05:25.041546 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 459/922] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:25.126858 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-62de8ca2-9420-46d9-bc05-76eacbf53cf2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "POST /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/action" status: 202 len: 0 microversion: 2.20 time: 0.598871 Jul 25 06:05:25.127467 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 464/923] 10.222.0.40 () {62 vars in 1318 bytes} [Mon Jul 25 06:05:24 2022] POST /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:05:25.137063 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6bf73fb9-6965-4e13-955f-ff94373a2223 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:25.137844 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6bf73fb9-6965-4e13-955f-ff94373a2223 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:25.144285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6bf73fb9-6965-4e13-955f-ff94373a2223 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.144736 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6bf73fb9-6965-4e13-955f-ff94373a2223 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.145512 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6bf73fb9-6965-4e13-955f-ff94373a2223 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.145956 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6bf73fb9-6965-4e13-955f-ff94373a2223 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.280275 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6bf73fb9-6965-4e13-955f-ff94373a2223 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:25.288452 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6bf73fb9-6965-4e13-955f-ff94373a2223 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:25.290001 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6bf73fb9-6965-4e13-955f-ff94373a2223 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:25.291156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6bf73fb9-6965-4e13-955f-ff94373a2223 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1722 microversion: 2.20 time: 0.158435 Jul 25 06:05:25.291782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 460/924] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:25 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:25.804055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6e0143c4-9925-47dd-b704-84aafa7f21fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:25.804939 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6e0143c4-9925-47dd-b704-84aafa7f21fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:25.811120 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e0143c4-9925-47dd-b704-84aafa7f21fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.811594 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e0143c4-9925-47dd-b704-84aafa7f21fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.812588 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e0143c4-9925-47dd-b704-84aafa7f21fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:25.813021 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6e0143c4-9925-47dd-b704-84aafa7f21fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:25.951579 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6e0143c4-9925-47dd-b704-84aafa7f21fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:25.959154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6e0143c4-9925-47dd-b704-84aafa7f21fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1368 microversion: 2.1 time: 0.160302 Jul 25 06:05:25.959716 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 465/925] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:25 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:26.310598 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a52e2434-d737-42de-a2df-3c6900393f6b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:26.311239 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-a52e2434-d737-42de-a2df-3c6900393f6b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:26.317718 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a52e2434-d737-42de-a2df-3c6900393f6b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:26.318235 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a52e2434-d737-42de-a2df-3c6900393f6b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:26.318982 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a52e2434-d737-42de-a2df-3c6900393f6b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:26.319416 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a52e2434-d737-42de-a2df-3c6900393f6b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:26.449164 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a52e2434-d737-42de-a2df-3c6900393f6b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:26.457096 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a52e2434-d737-42de-a2df-3c6900393f6b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:26.458726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a52e2434-d737-42de-a2df-3c6900393f6b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:26.459872 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a52e2434-d737-42de-a2df-3c6900393f6b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1722 microversion: 2.20 time: 0.153402 Jul 25 06:05:26.460451 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 461/926] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:26 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:05:26.975870 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7c07974f-adf0-4f92-9e72-37d6b4fb7bd3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:26.976609 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7c07974f-adf0-4f92-9e72-37d6b4fb7bd3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:26.983206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7c07974f-adf0-4f92-9e72-37d6b4fb7bd3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:26.983644 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7c07974f-adf0-4f92-9e72-37d6b4fb7bd3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:26.984451 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7c07974f-adf0-4f92-9e72-37d6b4fb7bd3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:26.984863 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7c07974f-adf0-4f92-9e72-37d6b4fb7bd3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:27.121366 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7c07974f-adf0-4f92-9e72-37d6b4fb7bd3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:27.129029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7c07974f-adf0-4f92-9e72-37d6b4fb7bd3 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1368 microversion: 2.1 time: 0.157087 Jul 25 06:05:27.129618 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 466/927] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:26 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:27.478462 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-54ed9e87-8dae-4c50-b537-e4844581c9dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:27.479082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-54ed9e87-8dae-4c50-b537-e4844581c9dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:27.485921 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-54ed9e87-8dae-4c50-b537-e4844581c9dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:27.486370 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-54ed9e87-8dae-4c50-b537-e4844581c9dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:27.487154 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-54ed9e87-8dae-4c50-b537-e4844581c9dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:27.487586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-54ed9e87-8dae-4c50-b537-e4844581c9dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:27.627740 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-54ed9e87-8dae-4c50-b537-e4844581c9dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:27.636814 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-54ed9e87-8dae-4c50-b537-e4844581c9dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:27.638312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-54ed9e87-8dae-4c50-b537-e4844581c9dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:27.639453 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-54ed9e87-8dae-4c50-b537-e4844581c9dc tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1722 microversion: 2.20 time: 0.165179 Jul 25 06:05:27.639994 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 462/928] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:27 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:28.147322 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-84206675-0c23-44b6-8d21-a51e7fd6d40a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:28.148716 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-84206675-0c23-44b6-8d21-a51e7fd6d40a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:28.154479 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84206675-0c23-44b6-8d21-a51e7fd6d40a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.154928 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84206675-0c23-44b6-8d21-a51e7fd6d40a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.155692 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84206675-0c23-44b6-8d21-a51e7fd6d40a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.156161 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84206675-0c23-44b6-8d21-a51e7fd6d40a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.284300 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-84206675-0c23-44b6-8d21-a51e7fd6d40a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:28.292087 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-84206675-0c23-44b6-8d21-a51e7fd6d40a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1558 microversion: 2.1 time: 0.149389 Jul 25 06:05:28.292719 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 467/929] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:28 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:28.309891 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1421f1b0-c7f1-4b1c-84ff-78ac9e0d5f76 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method InterfaceAttachmentController.index of <nova.api.openstack.compute.attach_interfaces.InterfaceAttachmentController object at 0x7f6533e93e80>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:28.310393 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1421f1b0-c7f1-4b1c-84ff-78ac9e0d5f76 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:28.316459 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1421f1b0-c7f1-4b1c-84ff-78ac9e0d5f76 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.316920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1421f1b0-c7f1-4b1c-84ff-78ac9e0d5f76 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.317691 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1421f1b0-c7f1-4b1c-84ff-78ac9e0d5f76 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.318138 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1421f1b0-c7f1-4b1c-84ff-78ac9e0d5f76 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.413053 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1421f1b0-c7f1-4b1c-84ff-78ac9e0d5f76 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107026 Jul 25 06:05:28.413772 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 463/930] 10.222.0.40 () {58 vars in 1274 bytes} [Mon Jul 25 06:05:28 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:28.658916 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7b861ebb-f45e-4d3f-a921-c32907e1e978 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:28.659866 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7b861ebb-f45e-4d3f-a921-c32907e1e978 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:28.668876 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b861ebb-f45e-4d3f-a921-c32907e1e978 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.669445 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b861ebb-f45e-4d3f-a921-c32907e1e978 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.670304 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b861ebb-f45e-4d3f-a921-c32907e1e978 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:28.670813 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b861ebb-f45e-4d3f-a921-c32907e1e978 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:28.824650 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7b861ebb-f45e-4d3f-a921-c32907e1e978 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:28.833264 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7b861ebb-f45e-4d3f-a921-c32907e1e978 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:28.835414 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7b861ebb-f45e-4d3f-a921-c32907e1e978 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:28.836830 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7b861ebb-f45e-4d3f-a921-c32907e1e978 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1722 microversion: 2.20 time: 0.182164 Jul 25 06:05:28.837586 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 468/931] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:28 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:29.856991 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f2fee804-9512-4bf5-991f-78ce5cc9c9df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:29.858348 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f2fee804-9512-4bf5-991f-78ce5cc9c9df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:29.867127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2fee804-9512-4bf5-991f-78ce5cc9c9df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:29.867127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2fee804-9512-4bf5-991f-78ce5cc9c9df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:29.867127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2fee804-9512-4bf5-991f-78ce5cc9c9df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:29.867476 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2fee804-9512-4bf5-991f-78ce5cc9c9df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:29.945306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-814aaedb-a781-401e-8b66-9d4ae949c6b1 req-ec802d04-4088-490f-9d41-d34a601ba252 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "d21512fe-e078-4674-bb50-659aeebf1a6b", "tag": "7da6481b-18b6-48f5-aaff-0f86837cc82a"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:29.955866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-814aaedb-a781-401e-8b66-9d4ae949c6b1 req-ec802d04-4088-490f-9d41-d34a601ba252 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:29.956336 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-814aaedb-a781-401e-8b66-9d4ae949c6b1 req-ec802d04-4088-490f-9d41-d34a601ba252 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:29.968437 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-814aaedb-a781-401e-8b66-9d4ae949c6b1 req-ec802d04-4088-490f-9d41-d34a601ba252 service nova] Creating event network-changed:7da6481b-18b6-48f5-aaff-0f86837cc82a for instance d21512fe-e078-4674-bb50-659aeebf1a6b on hv-cinder-84841 Jul 25 06:05:29.973488 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-814aaedb-a781-401e-8b66-9d4ae949c6b1 req-ec802d04-4088-490f-9d41-d34a601ba252 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171138 Jul 25 06:05:29.974648 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 464/932] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:30.061975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f2fee804-9512-4bf5-991f-78ce5cc9c9df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:30.077333 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f2fee804-9512-4bf5-991f-78ce5cc9c9df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:30.079132 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f2fee804-9512-4bf5-991f-78ce5cc9c9df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:30.080391 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f2fee804-9512-4bf5-991f-78ce5cc9c9df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1722 microversion: 2.20 time: 0.228880 Jul 25 06:05:30.081222 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 469/933] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:29 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:05:31.099906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b4a428ad-edb6-4f6b-a16d-14baa43793d9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:31.100848 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b4a428ad-edb6-4f6b-a16d-14baa43793d9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:31.107877 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b4a428ad-edb6-4f6b-a16d-14baa43793d9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:31.108471 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b4a428ad-edb6-4f6b-a16d-14baa43793d9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:31.109506 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b4a428ad-edb6-4f6b-a16d-14baa43793d9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:31.110193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b4a428ad-edb6-4f6b-a16d-14baa43793d9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:31.254341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b4a428ad-edb6-4f6b-a16d-14baa43793d9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:31.268625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b4a428ad-edb6-4f6b-a16d-14baa43793d9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:31.268625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b4a428ad-edb6-4f6b-a16d-14baa43793d9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:31.268625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b4a428ad-edb6-4f6b-a16d-14baa43793d9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1722 microversion: 2.20 time: 0.172176 Jul 25 06:05:31.268977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 465/934] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:31 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:32.286601 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-dfb37a70-11fd-412a-b515-c8e44ae640df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:32.287213 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-dfb37a70-11fd-412a-b515-c8e44ae640df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:32.295183 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dfb37a70-11fd-412a-b515-c8e44ae640df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:32.295625 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dfb37a70-11fd-412a-b515-c8e44ae640df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:32.296418 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dfb37a70-11fd-412a-b515-c8e44ae640df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:32.296849 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-dfb37a70-11fd-412a-b515-c8e44ae640df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:32.432141 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-dfb37a70-11fd-412a-b515-c8e44ae640df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:32.439975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-dfb37a70-11fd-412a-b515-c8e44ae640df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:32.441571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-dfb37a70-11fd-412a-b515-c8e44ae640df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:32.442707 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-dfb37a70-11fd-412a-b515-c8e44ae640df tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1722 microversion: 2.20 time: 0.160244 Jul 25 06:05:32.443263 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 470/935] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:32 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:33.461149 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5ea38ac0-5a6e-46e7-b771-9ccf92fb10e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:33.461766 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5ea38ac0-5a6e-46e7-b771-9ccf92fb10e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:33.468453 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ea38ac0-5a6e-46e7-b771-9ccf92fb10e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:33.468903 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ea38ac0-5a6e-46e7-b771-9ccf92fb10e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:33.469665 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ea38ac0-5a6e-46e7-b771-9ccf92fb10e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:33.470099 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5ea38ac0-5a6e-46e7-b771-9ccf92fb10e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:33.474261 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:33.606798 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5ea38ac0-5a6e-46e7-b771-9ccf92fb10e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:33.614739 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5ea38ac0-5a6e-46e7-b771-9ccf92fb10e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:33.616286 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5ea38ac0-5a6e-46e7-b771-9ccf92fb10e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:33.617433 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5ea38ac0-5a6e-46e7-b771-9ccf92fb10e7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1722 microversion: 2.20 time: 0.160842 Jul 25 06:05:33.618050 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 466/936] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:33 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:34.145416 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b6368f19-4ddb-47e6-adb4-95f83559abb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method IPsController.index of <nova.api.openstack.compute.ips.IPsController object at 0x7f6533ee6fa0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:34.145958 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b6368f19-4ddb-47e6-adb4-95f83559abb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:34.152734 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b6368f19-4ddb-47e6-adb4-95f83559abb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:34.153187 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b6368f19-4ddb-47e6-adb4-95f83559abb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:34.154001 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b6368f19-4ddb-47e6-adb4-95f83559abb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:34.154446 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b6368f19-4ddb-47e6-adb4-95f83559abb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:34.177527 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b6368f19-4ddb-47e6-adb4-95f83559abb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/ips" status: 200 len: 147 microversion: 2.1 time: 0.036067 Jul 25 06:05:34.178109 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 471/937] 10.222.0.40 () {58 vars in 1247 bytes} [Mon Jul 25 06:05:34 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:34.635198 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-27ddcf73-0820-4bd5-aa37-8cf85900813e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:34.635912 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-27ddcf73-0820-4bd5-aa37-8cf85900813e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:34.643162 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-27ddcf73-0820-4bd5-aa37-8cf85900813e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:34.643617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-27ddcf73-0820-4bd5-aa37-8cf85900813e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:34.644420 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-27ddcf73-0820-4bd5-aa37-8cf85900813e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:34.644858 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-27ddcf73-0820-4bd5-aa37-8cf85900813e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:34.787208 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-27ddcf73-0820-4bd5-aa37-8cf85900813e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:34.797526 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-27ddcf73-0820-4bd5-aa37-8cf85900813e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:34.798897 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-27ddcf73-0820-4bd5-aa37-8cf85900813e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:34.800148 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-27ddcf73-0820-4bd5-aa37-8cf85900813e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1722 microversion: 2.20 time: 0.169037 Jul 25 06:05:34.800771 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 467/938] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:34 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:35.825870 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-16db6954-6b6e-4669-8116-b62d6c35e30e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:35.825870 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-16db6954-6b6e-4669-8116-b62d6c35e30e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:35.827531 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16db6954-6b6e-4669-8116-b62d6c35e30e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:35.828059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16db6954-6b6e-4669-8116-b62d6c35e30e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:35.829039 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16db6954-6b6e-4669-8116-b62d6c35e30e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:35.830929 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-16db6954-6b6e-4669-8116-b62d6c35e30e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:35.833025 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-40e04eb7-8443-427b-b2e0-5aef3506365d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f1c0>>, body: {"volumeAttachment": {"volumeId": "0274abb9-4df3-4fa4-8213-2604b742cf10"}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:35.834217 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-40e04eb7-8443-427b-b2e0-5aef3506365d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:35.841056 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-40e04eb7-8443-427b-b2e0-5aef3506365d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:35.841753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-40e04eb7-8443-427b-b2e0-5aef3506365d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:35.842516 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-40e04eb7-8443-427b-b2e0-5aef3506365d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:35.842952 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-40e04eb7-8443-427b-b2e0-5aef3506365d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:35.972662 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-16db6954-6b6e-4669-8116-b62d6c35e30e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:35.981888 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-16db6954-6b6e-4669-8116-b62d6c35e30e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:35.983848 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-16db6954-6b6e-4669-8116-b62d6c35e30e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:35.984892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-16db6954-6b6e-4669-8116-b62d6c35e30e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1743 microversion: 2.20 time: 0.170294 Jul 25 06:05:35.985622 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 472/939] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:35 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:36.588312 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-40e04eb7-8443-427b-b2e0-5aef3506365d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "POST /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.760067 Jul 25 06:05:36.588945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 468/940] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:05:35 2022] POST /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:37.003955 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3e706090-5985-4824-868c-3c8155c2136b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:37.004890 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3e706090-5985-4824-868c-3c8155c2136b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:37.012854 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3e706090-5985-4824-868c-3c8155c2136b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:37.013394 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3e706090-5985-4824-868c-3c8155c2136b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:37.014361 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3e706090-5985-4824-868c-3c8155c2136b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:37.014804 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3e706090-5985-4824-868c-3c8155c2136b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:37.164004 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3e706090-5985-4824-868c-3c8155c2136b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:37.172023 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3e706090-5985-4824-868c-3c8155c2136b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:37.174060 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3e706090-5985-4824-868c-3c8155c2136b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:37.175240 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3e706090-5985-4824-868c-3c8155c2136b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1743 microversion: 2.20 time: 0.175380 Jul 25 06:05:37.175799 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 473/941] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:36 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:38.196832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f9563169-d867-4bd6-bf73-7a3de73f0942 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:38.197973 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f9563169-d867-4bd6-bf73-7a3de73f0942 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:38.212169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f9563169-d867-4bd6-bf73-7a3de73f0942 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:38.212169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f9563169-d867-4bd6-bf73-7a3de73f0942 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:38.212169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f9563169-d867-4bd6-bf73-7a3de73f0942 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:38.212169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f9563169-d867-4bd6-bf73-7a3de73f0942 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:38.438564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f9563169-d867-4bd6-bf73-7a3de73f0942 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:38.451089 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f9563169-d867-4bd6-bf73-7a3de73f0942 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:38.453006 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f9563169-d867-4bd6-bf73-7a3de73f0942 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:38.454306 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f9563169-d867-4bd6-bf73-7a3de73f0942 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1743 microversion: 2.20 time: 0.263230 Jul 25 06:05:38.455299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 469/942] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:38 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1743 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:39.474775 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d56689d3-4724-4608-9469-a30251009760 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:39.475368 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d56689d3-4724-4608-9469-a30251009760 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:39.486454 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d56689d3-4724-4608-9469-a30251009760 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:39.487172 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d56689d3-4724-4608-9469-a30251009760 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:39.488199 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d56689d3-4724-4608-9469-a30251009760 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:39.488785 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d56689d3-4724-4608-9469-a30251009760 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:39.649716 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d56689d3-4724-4608-9469-a30251009760 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:39.659135 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d56689d3-4724-4608-9469-a30251009760 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:39.660925 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d56689d3-4724-4608-9469-a30251009760 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:39.662289 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d56689d3-4724-4608-9469-a30251009760 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1738 microversion: 2.20 time: 0.191477 Jul 25 06:05:39.662840 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 474/943] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:39 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:40.684299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-57809889-ff21-4121-80c3-dac299cdc36a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:40.685719 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-57809889-ff21-4121-80c3-dac299cdc36a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:40.722670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-57809889-ff21-4121-80c3-dac299cdc36a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:40.722670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-57809889-ff21-4121-80c3-dac299cdc36a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:40.722670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-57809889-ff21-4121-80c3-dac299cdc36a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:40.722670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-57809889-ff21-4121-80c3-dac299cdc36a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:40.958108 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-57809889-ff21-4121-80c3-dac299cdc36a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:40.970576 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-57809889-ff21-4121-80c3-dac299cdc36a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:40.979421 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-57809889-ff21-4121-80c3-dac299cdc36a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:40.979421 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-57809889-ff21-4121-80c3-dac299cdc36a tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1738 microversion: 2.20 time: 0.295384 Jul 25 06:05:40.979421 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 470/944] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:40 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:41.049558 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-73b36253-7ca5-43de-85e2-40bca908b202 req-1d68c174-ff79-4a7f-a5a7-c9a560e03e2f service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "5e834f53-fb25-48ed-a03c-33717c1e39ff", "name": "network-vif-plugged", "status": "completed", "tag": "ca3ad013-ac59-49fd-a355-d63dbc1c3385"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:41.059314 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-73b36253-7ca5-43de-85e2-40bca908b202 req-1d68c174-ff79-4a7f-a5a7-c9a560e03e2f service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:41.059759 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-73b36253-7ca5-43de-85e2-40bca908b202 req-1d68c174-ff79-4a7f-a5a7-c9a560e03e2f service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:41.080706 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-73b36253-7ca5-43de-85e2-40bca908b202 req-1d68c174-ff79-4a7f-a5a7-c9a560e03e2f service nova] Creating event network-vif-plugged:ca3ad013-ac59-49fd-a355-d63dbc1c3385 for instance 5e834f53-fb25-48ed-a03c-33717c1e39ff on hv-cinder-84841 Jul 25 06:05:41.091351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-73b36253-7ca5-43de-85e2-40bca908b202 req-1d68c174-ff79-4a7f-a5a7-c9a560e03e2f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052961 Jul 25 06:05:41.092353 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 475/945] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:41.998577 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7f9a350f-98e0-4740-aab8-65b28eb4a535 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:42.002706 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7f9a350f-98e0-4740-aab8-65b28eb4a535 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:42.006059 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7f9a350f-98e0-4740-aab8-65b28eb4a535 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:42.006513 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7f9a350f-98e0-4740-aab8-65b28eb4a535 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:42.007625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7f9a350f-98e0-4740-aab8-65b28eb4a535 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:42.008074 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7f9a350f-98e0-4740-aab8-65b28eb4a535 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:42.137528 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7f9a350f-98e0-4740-aab8-65b28eb4a535 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:42.146177 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7f9a350f-98e0-4740-aab8-65b28eb4a535 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:42.147766 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-7f9a350f-98e0-4740-aab8-65b28eb4a535 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:42.151465 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7f9a350f-98e0-4740-aab8-65b28eb4a535 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1738 microversion: 2.20 time: 0.154577 Jul 25 06:05:42.155664 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 471/946] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:41 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:43.168664 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-b211086a-cb15-4ac7-85a1-ce193dd7393e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:43.169543 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-b211086a-cb15-4ac7-85a1-ce193dd7393e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:43.180858 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b211086a-cb15-4ac7-85a1-ce193dd7393e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:43.181462 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b211086a-cb15-4ac7-85a1-ce193dd7393e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:43.182347 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b211086a-cb15-4ac7-85a1-ce193dd7393e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:43.182865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-b211086a-cb15-4ac7-85a1-ce193dd7393e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:43.345233 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b211086a-cb15-4ac7-85a1-ce193dd7393e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:43.356526 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b211086a-cb15-4ac7-85a1-ce193dd7393e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:43.358459 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-b211086a-cb15-4ac7-85a1-ce193dd7393e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:43.359655 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-b211086a-cb15-4ac7-85a1-ce193dd7393e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1738 microversion: 2.20 time: 0.196495 Jul 25 06:05:43.371117 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 476/947] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:43 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:44.183379 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e04d30de-d634-4b46-a93a-3d767cf3b1f9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:44.184382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e04d30de-d634-4b46-a93a-3d767cf3b1f9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:44.191224 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e04d30de-d634-4b46-a93a-3d767cf3b1f9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:44.191909 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e04d30de-d634-4b46-a93a-3d767cf3b1f9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:44.192867 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e04d30de-d634-4b46-a93a-3d767cf3b1f9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:44.193475 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e04d30de-d634-4b46-a93a-3d767cf3b1f9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:44.225523 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e04d30de-d634-4b46-a93a-3d767cf3b1f9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047255 Jul 25 06:05:44.226832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 472/948] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:44 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:44.236912 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0646d2cc-30d5-4ab9-9f1b-044c986669d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method VolumeAttachmentController.show of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ead730>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:44.237452 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-0646d2cc-30d5-4ab9-9f1b-044c986669d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:44.246889 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0646d2cc-30d5-4ab9-9f1b-044c986669d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:44.247343 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0646d2cc-30d5-4ab9-9f1b-044c986669d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:44.248364 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0646d2cc-30d5-4ab9-9f1b-044c986669d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:44.249126 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0646d2cc-30d5-4ab9-9f1b-044c986669d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:44.279892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0646d2cc-30d5-4ab9-9f1b-044c986669d9 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments/0274abb9-4df3-4fa4-8213-2604b742cf10" status: 200 len: 194 microversion: 2.1 time: 0.046866 Jul 25 06:05:44.280753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 477/949] 10.222.0.40 () {58 vars in 1412 bytes} [Mon Jul 25 06:05:44 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments/0274abb9-4df3-4fa4-8213-2604b742cf10 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:44.391027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f7f352d6-6c6f-4a63-b2a2-5b521c8bb0b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:44.391657 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f7f352d6-6c6f-4a63-b2a2-5b521c8bb0b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:44.407010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f7f352d6-6c6f-4a63-b2a2-5b521c8bb0b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:44.407010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f7f352d6-6c6f-4a63-b2a2-5b521c8bb0b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:44.407010 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f7f352d6-6c6f-4a63-b2a2-5b521c8bb0b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:44.407405 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f7f352d6-6c6f-4a63-b2a2-5b521c8bb0b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:44.592796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f7f352d6-6c6f-4a63-b2a2-5b521c8bb0b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:44.604478 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f7f352d6-6c6f-4a63-b2a2-5b521c8bb0b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:44.606139 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f7f352d6-6c6f-4a63-b2a2-5b521c8bb0b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:44.607956 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f7f352d6-6c6f-4a63-b2a2-5b521c8bb0b5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1738 microversion: 2.20 time: 0.233037 Jul 25 06:05:44.623215 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 473/950] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:44 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:45.493585 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-733850cf-27e9-4fd2-8911-24aff6cf3e9e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Action: 'action', calling method: <bound method SecurityGroupActionController._removeSecurityGroup of <nova.api.openstack.compute.security_groups.SecurityGroupActionController object at 0x7f6533f49520>>, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1993873638"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:45.494746 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-733850cf-27e9-4fd2-8911-24aff6cf3e9e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:45.501601 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-733850cf-27e9-4fd2-8911-24aff6cf3e9e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:45.502056 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-733850cf-27e9-4fd2-8911-24aff6cf3e9e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:45.502850 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-733850cf-27e9-4fd2-8911-24aff6cf3e9e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:45.503287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-733850cf-27e9-4fd2-8911-24aff6cf3e9e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:45.628060 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a32805ba-55ea-4de0-9bf1-0a11ae63064e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:45.628714 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-a32805ba-55ea-4de0-9bf1-0a11ae63064e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:45.636742 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a32805ba-55ea-4de0-9bf1-0a11ae63064e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:45.637523 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a32805ba-55ea-4de0-9bf1-0a11ae63064e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:45.638664 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a32805ba-55ea-4de0-9bf1-0a11ae63064e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:45.639130 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a32805ba-55ea-4de0-9bf1-0a11ae63064e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:45.641328 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.network.security_group_api [None req-733850cf-27e9-4fd2-8911-24aff6cf3e9e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Removing security group 675ab1fb-63b1-4425-be55-46d9266a0914 from port 279fa404-535f-4110-9863-de45be0f04f9 Jul 25 06:05:45.827865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a32805ba-55ea-4de0-9bf1-0a11ae63064e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:45.839161 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a32805ba-55ea-4de0-9bf1-0a11ae63064e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:45.852289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a32805ba-55ea-4de0-9bf1-0a11ae63064e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:45.852289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a32805ba-55ea-4de0-9bf1-0a11ae63064e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1738 microversion: 2.20 time: 0.219122 Jul 25 06:05:45.852289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 474/951] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:45 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:46.191621 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-733850cf-27e9-4fd2-8911-24aff6cf3e9e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "POST /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.703610 Jul 25 06:05:46.196190 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 478/952] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:05:45 2022] POST /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:05:46.206465 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-4cc3c572-31fd-426b-9beb-413dfef12967 req-b129bd84-c65a-4904-a9b5-1083547d35b5 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "4c88e17a-19b8-4f75-bbe7-01c014030a3a", "tag": "279fa404-535f-4110-9863-de45be0f04f9"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:46.221797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-4cc3c572-31fd-426b-9beb-413dfef12967 req-b129bd84-c65a-4904-a9b5-1083547d35b5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:46.224841 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-4cc3c572-31fd-426b-9beb-413dfef12967 req-b129bd84-c65a-4904-a9b5-1083547d35b5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:46.251625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-4cc3c572-31fd-426b-9beb-413dfef12967 req-b129bd84-c65a-4904-a9b5-1083547d35b5 service nova] Creating event network-changed:279fa404-535f-4110-9863-de45be0f04f9 for instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a on hv-cinder-84841 Jul 25 06:05:46.269322 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-4cc3c572-31fd-426b-9beb-413dfef12967 req-b129bd84-c65a-4904-a9b5-1083547d35b5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068171 Jul 25 06:05:46.272432 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 475/953] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:46.868697 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-63278f6b-7093-4d6e-a1cb-f8ac7d94bc83 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:46.868697 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-63278f6b-7093-4d6e-a1cb-f8ac7d94bc83 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:46.868697 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=38 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:46.881768 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-63278f6b-7093-4d6e-a1cb-f8ac7d94bc83 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:46.882634 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-63278f6b-7093-4d6e-a1cb-f8ac7d94bc83 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:46.886658 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-63278f6b-7093-4d6e-a1cb-f8ac7d94bc83 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:46.888728 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-63278f6b-7093-4d6e-a1cb-f8ac7d94bc83 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:46.919036 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:47.111833 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5b8ec28b-16ce-46f5-8d56-a08aea7d14ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f1c0>>, body: {"volumeAttachment": {"volumeId": "8646e653-b711-4ffe-bd52-19f0d6911214"}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:47.114287 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5b8ec28b-16ce-46f5-8d56-a08aea7d14ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:47.122616 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5b8ec28b-16ce-46f5-8d56-a08aea7d14ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:47.123811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5b8ec28b-16ce-46f5-8d56-a08aea7d14ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:47.125293 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5b8ec28b-16ce-46f5-8d56-a08aea7d14ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:47.125895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5b8ec28b-16ce-46f5-8d56-a08aea7d14ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:47.222075 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-63278f6b-7093-4d6e-a1cb-f8ac7d94bc83 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:47.233660 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-63278f6b-7093-4d6e-a1cb-f8ac7d94bc83 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:47.235484 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-63278f6b-7093-4d6e-a1cb-f8ac7d94bc83 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:47.238966 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-63278f6b-7093-4d6e-a1cb-f8ac7d94bc83 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1738 microversion: 2.20 time: 0.381564 Jul 25 06:05:47.241414 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 479/954] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:46 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1738 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:47.884823 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5b8ec28b-16ce-46f5-8d56-a08aea7d14ce tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "POST /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779162 Jul 25 06:05:47.885712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 476/955] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:05:47 2022] POST /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:47.962427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ae4fc73a-648b-4180-ae2c-fe2f3e6e0ce3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4850>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:47.963032 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ae4fc73a-648b-4180-ae2c-fe2f3e6e0ce3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:47.972858 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-2ffdd37e-83ef-45f2-9d58-4918ac716974 req-c0cb9454-b485-4053-b491-fb98fc552d6c service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "4c88e17a-19b8-4f75-bbe7-01c014030a3a", "tag": "279fa404-535f-4110-9863-de45be0f04f9"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:47.981257 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae4fc73a-648b-4180-ae2c-fe2f3e6e0ce3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:47.982059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae4fc73a-648b-4180-ae2c-fe2f3e6e0ce3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:47.983515 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae4fc73a-648b-4180-ae2c-fe2f3e6e0ce3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:47.984159 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ae4fc73a-648b-4180-ae2c-fe2f3e6e0ce3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:47.989210 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-2ffdd37e-83ef-45f2-9d58-4918ac716974 req-c0cb9454-b485-4053-b491-fb98fc552d6c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:47.989649 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-2ffdd37e-83ef-45f2-9d58-4918ac716974 req-c0cb9454-b485-4053-b491-fb98fc552d6c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:48.016845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-2ffdd37e-83ef-45f2-9d58-4918ac716974 req-c0cb9454-b485-4053-b491-fb98fc552d6c service nova] Creating event network-changed:279fa404-535f-4110-9863-de45be0f04f9 for instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a on hv-cinder-84841 Jul 25 06:05:48.037411 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-2ffdd37e-83ef-45f2-9d58-4918ac716974 req-c0cb9454-b485-4053-b491-fb98fc552d6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069416 Jul 25 06:05:48.043146 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 477/956] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:48.127413 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-ae4fc73a-648b-4180-ae2c-fe2f3e6e0ce3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lazy-loading 'services' on Instance uuid 4c88e17a-19b8-4f75-bbe7-01c014030a3a {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:05:48.263031 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-914680a0-4475-4074-9556-e4f2e2e76b6d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:48.265099 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-914680a0-4475-4074-9556-e4f2e2e76b6d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:48.272764 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-914680a0-4475-4074-9556-e4f2e2e76b6d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:48.273827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-914680a0-4475-4074-9556-e4f2e2e76b6d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:48.276379 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-914680a0-4475-4074-9556-e4f2e2e76b6d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:48.277006 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-914680a0-4475-4074-9556-e4f2e2e76b6d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:48.508894 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-914680a0-4475-4074-9556-e4f2e2e76b6d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:48.519163 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-914680a0-4475-4074-9556-e4f2e2e76b6d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:48.521190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-914680a0-4475-4074-9556-e4f2e2e76b6d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:48.523200 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-914680a0-4475-4074-9556-e4f2e2e76b6d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1738 microversion: 2.20 time: 0.266008 Jul 25 06:05:48.524560 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 478/957] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:48 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:05:48.663527 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ae4fc73a-648b-4180-ae2c-fe2f3e6e0ce3 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments/8bc82f01-3714-4a66-9651-bc7a87550a20" status: 202 len: 0 microversion: 2.1 time: 0.705043 Jul 25 06:05:48.664898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 480/958] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:05:47 2022] DELETE /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments/8bc82f01-3714-4a66-9651-bc7a87550a20 => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:05:48.674215 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b838a4f5-c736-4b64-ade5-d314804f3410 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:48.675165 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b838a4f5-c736-4b64-ade5-d314804f3410 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:48.687471 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b838a4f5-c736-4b64-ade5-d314804f3410 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:48.687927 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b838a4f5-c736-4b64-ade5-d314804f3410 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:48.693043 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b838a4f5-c736-4b64-ade5-d314804f3410 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:48.693504 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b838a4f5-c736-4b64-ade5-d314804f3410 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:48.737467 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b838a4f5-c736-4b64-ade5-d314804f3410 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068338 Jul 25 06:05:48.738042 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 479/959] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:48 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:49.542960 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-28cc11ea-6dd6-4041-bd42-a62ed3a371e0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:49.543601 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-28cc11ea-6dd6-4041-bd42-a62ed3a371e0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:49.549847 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-28cc11ea-6dd6-4041-bd42-a62ed3a371e0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:49.550297 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-28cc11ea-6dd6-4041-bd42-a62ed3a371e0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:49.551069 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-28cc11ea-6dd6-4041-bd42-a62ed3a371e0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:49.551505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-28cc11ea-6dd6-4041-bd42-a62ed3a371e0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:49.686634 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-28cc11ea-6dd6-4041-bd42-a62ed3a371e0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:49.695450 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-28cc11ea-6dd6-4041-bd42-a62ed3a371e0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:49.700223 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-28cc11ea-6dd6-4041-bd42-a62ed3a371e0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:49.701449 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-28cc11ea-6dd6-4041-bd42-a62ed3a371e0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1738 microversion: 2.20 time: 0.164258 Jul 25 06:05:49.702081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 481/960] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:49 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:49.749740 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a33b37a6-9963-45cc-bbbe-a772cf498b24 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:49.750775 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-a33b37a6-9963-45cc-bbbe-a772cf498b24 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:49.758245 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a33b37a6-9963-45cc-bbbe-a772cf498b24 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:49.759063 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a33b37a6-9963-45cc-bbbe-a772cf498b24 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:49.759899 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a33b37a6-9963-45cc-bbbe-a772cf498b24 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:49.760428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a33b37a6-9963-45cc-bbbe-a772cf498b24 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:49.792828 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a33b37a6-9963-45cc-bbbe-a772cf498b24 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047036 Jul 25 06:05:49.793452 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 480/961] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:49 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:50.719849 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5b0e6303-21ad-466a-a397-56106b29ee9f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:50.720503 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5b0e6303-21ad-466a-a397-56106b29ee9f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:50.727516 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b0e6303-21ad-466a-a397-56106b29ee9f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:50.727957 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b0e6303-21ad-466a-a397-56106b29ee9f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:50.728791 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b0e6303-21ad-466a-a397-56106b29ee9f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:50.729219 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5b0e6303-21ad-466a-a397-56106b29ee9f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:50.804457 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9e3be9ba-d769-44f4-81ca-638b4bb70237 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:50.805571 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9e3be9ba-d769-44f4-81ca-638b4bb70237 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:50.812722 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9e3be9ba-d769-44f4-81ca-638b4bb70237 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:50.813174 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9e3be9ba-d769-44f4-81ca-638b4bb70237 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:50.814444 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9e3be9ba-d769-44f4-81ca-638b4bb70237 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:50.814444 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9e3be9ba-d769-44f4-81ca-638b4bb70237 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:50.828879 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:50.846883 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9e3be9ba-d769-44f4-81ca-638b4bb70237 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046610 Jul 25 06:05:50.847460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 481/962] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:50 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:50.873193 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5b0e6303-21ad-466a-a397-56106b29ee9f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:50.881056 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5b0e6303-21ad-466a-a397-56106b29ee9f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:50.882597 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5b0e6303-21ad-466a-a397-56106b29ee9f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:50.884293 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5b0e6303-21ad-466a-a397-56106b29ee9f tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1738 microversion: 2.20 time: 0.168497 Jul 25 06:05:50.884839 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 482/963] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:50 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:51.860420 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-da37d9e8-9f68-49cc-87ce-6bb0efb5436d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:51.861428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-da37d9e8-9f68-49cc-87ce-6bb0efb5436d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:51.864135 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=54 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:51.869852 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-da37d9e8-9f68-49cc-87ce-6bb0efb5436d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:51.870304 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-da37d9e8-9f68-49cc-87ce-6bb0efb5436d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:51.871177 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-da37d9e8-9f68-49cc-87ce-6bb0efb5436d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:51.871497 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-da37d9e8-9f68-49cc-87ce-6bb0efb5436d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:51.900710 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-da37d9e8-9f68-49cc-87ce-6bb0efb5436d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044364 Jul 25 06:05:51.901526 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 482/964] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:51 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:51.902681 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-cc2ac0f4-4562-4ecd-9500-03faebf8a6cb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:51.903456 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-cc2ac0f4-4562-4ecd-9500-03faebf8a6cb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:51.910320 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cc2ac0f4-4562-4ecd-9500-03faebf8a6cb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:51.910769 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cc2ac0f4-4562-4ecd-9500-03faebf8a6cb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:51.911541 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cc2ac0f4-4562-4ecd-9500-03faebf8a6cb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:51.912029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cc2ac0f4-4562-4ecd-9500-03faebf8a6cb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:52.124905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cc2ac0f4-4562-4ecd-9500-03faebf8a6cb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:52.133641 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cc2ac0f4-4562-4ecd-9500-03faebf8a6cb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:52.135270 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cc2ac0f4-4562-4ecd-9500-03faebf8a6cb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:52.136750 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-cc2ac0f4-4562-4ecd-9500-03faebf8a6cb tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1720 microversion: 2.20 time: 0.238232 Jul 25 06:05:52.137050 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 483/965] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:51 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1720 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:52.912613 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c69ee089-5944-43c9-9da8-129d5d33bf53 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:52.913542 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c69ee089-5944-43c9-9da8-129d5d33bf53 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:52.921529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c69ee089-5944-43c9-9da8-129d5d33bf53 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:52.922145 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c69ee089-5944-43c9-9da8-129d5d33bf53 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:52.922921 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c69ee089-5944-43c9-9da8-129d5d33bf53 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:52.923362 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c69ee089-5944-43c9-9da8-129d5d33bf53 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:52.953971 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c69ee089-5944-43c9-9da8-129d5d33bf53 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045948 Jul 25 06:05:52.954470 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 483/966] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:52 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:53.155133 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-34a00d12-36ba-4e0f-962f-13ead337591d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:53.155755 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-34a00d12-36ba-4e0f-962f-13ead337591d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:53.162235 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34a00d12-36ba-4e0f-962f-13ead337591d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.166316 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34a00d12-36ba-4e0f-962f-13ead337591d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:53.166316 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34a00d12-36ba-4e0f-962f-13ead337591d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.166316 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-34a00d12-36ba-4e0f-962f-13ead337591d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:53.313668 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-34a00d12-36ba-4e0f-962f-13ead337591d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:53.322095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-34a00d12-36ba-4e0f-962f-13ead337591d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:53.323600 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-34a00d12-36ba-4e0f-962f-13ead337591d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:53.324779 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-34a00d12-36ba-4e0f-962f-13ead337591d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1720 microversion: 2.20 time: 0.173606 Jul 25 06:05:53.325335 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 484/967] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:53 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:53.967017 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-85fcf746-1394-446e-8c8d-a502cfa8612c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:53.967969 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-85fcf746-1394-446e-8c8d-a502cfa8612c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:53.974633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-85fcf746-1394-446e-8c8d-a502cfa8612c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.975082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-85fcf746-1394-446e-8c8d-a502cfa8612c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:53.975842 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-85fcf746-1394-446e-8c8d-a502cfa8612c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:53.976326 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-85fcf746-1394-446e-8c8d-a502cfa8612c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:54.004246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-85fcf746-1394-446e-8c8d-a502cfa8612c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041798 Jul 25 06:05:54.004791 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 484/968] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:53 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:54.342559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-046c83fc-593e-4196-ac6c-1d3ee50fc62b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:54.343170 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-046c83fc-593e-4196-ac6c-1d3ee50fc62b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:54.349775 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-046c83fc-593e-4196-ac6c-1d3ee50fc62b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:54.350239 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-046c83fc-593e-4196-ac6c-1d3ee50fc62b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:54.351023 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-046c83fc-593e-4196-ac6c-1d3ee50fc62b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:54.351463 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-046c83fc-593e-4196-ac6c-1d3ee50fc62b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:54.488455 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-046c83fc-593e-4196-ac6c-1d3ee50fc62b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:54.497229 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-046c83fc-593e-4196-ac6c-1d3ee50fc62b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:54.498833 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-046c83fc-593e-4196-ac6c-1d3ee50fc62b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:54.500199 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-046c83fc-593e-4196-ac6c-1d3ee50fc62b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1723 microversion: 2.20 time: 0.161369 Jul 25 06:05:54.503677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 485/969] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:54 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:54.518299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-85342795-d74b-4266-a49e-42ad3e967fdf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f1c0>>, body: {"volumeAttachment": {"volumeId": "eaf90d13-78c4-455c-acea-45991140de1b"}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:54.519365 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-85342795-d74b-4266-a49e-42ad3e967fdf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:54.526012 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-85342795-d74b-4266-a49e-42ad3e967fdf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:54.526463 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-85342795-d74b-4266-a49e-42ad3e967fdf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:54.527227 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-85342795-d74b-4266-a49e-42ad3e967fdf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:54.527657 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-85342795-d74b-4266-a49e-42ad3e967fdf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:55.021083 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f6b6cac4-9d02-4fc7-a798-fbd9131fa7ce tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:55.022703 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f6b6cac4-9d02-4fc7-a798-fbd9131fa7ce tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:55.032427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f6b6cac4-9d02-4fc7-a798-fbd9131fa7ce tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:55.032952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f6b6cac4-9d02-4fc7-a798-fbd9131fa7ce tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:55.034272 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f6b6cac4-9d02-4fc7-a798-fbd9131fa7ce tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:55.034984 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f6b6cac4-9d02-4fc7-a798-fbd9131fa7ce tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:55.092340 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f6b6cac4-9d02-4fc7-a798-fbd9131fa7ce tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078281 Jul 25 06:05:55.096632 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 486/970] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:55 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:55.191252 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-86f1bc0f-d7b7-42b0-bd2b-546e86256312 req-72629135-9803-4ed0-8fe1-36bea0ff2577 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "5e834f53-fb25-48ed-a03c-33717c1e39ff", "name": "network-vif-unplugged", "status": "completed", "tag": "ca3ad013-ac59-49fd-a355-d63dbc1c3385"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:55.199599 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-86f1bc0f-d7b7-42b0-bd2b-546e86256312 req-72629135-9803-4ed0-8fe1-36bea0ff2577 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:55.200047 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-86f1bc0f-d7b7-42b0-bd2b-546e86256312 req-72629135-9803-4ed0-8fe1-36bea0ff2577 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:55.212629 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-86f1bc0f-d7b7-42b0-bd2b-546e86256312 req-72629135-9803-4ed0-8fe1-36bea0ff2577 service nova] Creating event network-vif-unplugged:ca3ad013-ac59-49fd-a355-d63dbc1c3385 for instance 5e834f53-fb25-48ed-a03c-33717c1e39ff on hv-cinder-84841 Jul 25 06:05:55.217996 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-86f1bc0f-d7b7-42b0-bd2b-546e86256312 req-72629135-9803-4ed0-8fe1-36bea0ff2577 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030375 Jul 25 06:05:55.218855 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 487/971] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:55.515193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-85342795-d74b-4266-a49e-42ad3e967fdf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "POST /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.000843 Jul 25 06:05:55.515811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 485/972] 10.222.0.40 () {62 vars in 1363 bytes} [Mon Jul 25 06:05:54 2022] POST /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/os-volume_attachments => generated 188 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 06:05:55.634276 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-55c3c6fc-bb2a-403e-a326-1f8dbc3c89ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4850>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:55.634855 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-55c3c6fc-bb2a-403e-a326-1f8dbc3c89ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:55.641064 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55c3c6fc-bb2a-403e-a326-1f8dbc3c89ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:55.641510 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55c3c6fc-bb2a-403e-a326-1f8dbc3c89ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:55.642274 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55c3c6fc-bb2a-403e-a326-1f8dbc3c89ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:55.642711 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-55c3c6fc-bb2a-403e-a326-1f8dbc3c89ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.104972 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f72d8276-8353-4f39-a85b-c46720e987c2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:56.105990 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f72d8276-8353-4f39-a85b-c46720e987c2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:56.113376 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f72d8276-8353-4f39-a85b-c46720e987c2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.113827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f72d8276-8353-4f39-a85b-c46720e987c2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.114585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f72d8276-8353-4f39-a85b-c46720e987c2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.115027 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f72d8276-8353-4f39-a85b-c46720e987c2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.144573 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f72d8276-8353-4f39-a85b-c46720e987c2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Jul 25 06:05:56.145122 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 486/973] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:56 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:56.294912 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-55c3c6fc-bb2a-403e-a326-1f8dbc3c89ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/os-volume_attachments/eaf90d13-78c4-455c-acea-45991140de1b" status: 202 len: 0 microversion: 2.20 time: 0.665888 Jul 25 06:05:56.298922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 488/974] 10.222.0.40 () {60 vars in 1456 bytes} [Mon Jul 25 06:05:55 2022] DELETE /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/os-volume_attachments/eaf90d13-78c4-455c-acea-45991140de1b => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:05:56.351129 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4c8e8232-e960-4357-9ce6-7fbf98b76999 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Action: 'action', calling method: <bound method ShelveController._unshelve of <nova.api.openstack.compute.shelve.ShelveController object at 0x7f6533edea90>>, body: {"unshelve": null} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:05:56.352236 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4c8e8232-e960-4357-9ce6-7fbf98b76999 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:56.358767 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4c8e8232-e960-4357-9ce6-7fbf98b76999 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.358767 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4c8e8232-e960-4357-9ce6-7fbf98b76999 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.366875 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4c8e8232-e960-4357-9ce6-7fbf98b76999 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.366875 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4c8e8232-e960-4357-9ce6-7fbf98b76999 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.599536 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-70c36b9c-67a9-4803-81a3-670ef073cc9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:56.600725 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-70c36b9c-67a9-4803-81a3-670ef073cc9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:56.608197 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-70c36b9c-67a9-4803-81a3-670ef073cc9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.608826 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-70c36b9c-67a9-4803-81a3-670ef073cc9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.609595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-70c36b9c-67a9-4803-81a3-670ef073cc9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.610070 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-70c36b9c-67a9-4803-81a3-670ef073cc9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.643724 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-70c36b9c-67a9-4803-81a3-670ef073cc9f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048417 Jul 25 06:05:56.649086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 489/975] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:56 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:05:56.732655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4c8e8232-e960-4357-9ce6-7fbf98b76999 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "POST /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/action" status: 202 len: 0 microversion: 2.20 time: 0.385375 Jul 25 06:05:56.734124 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 487/976] 10.222.0.40 () {62 vars in 1318 bytes} [Mon Jul 25 06:05:56 2022] POST /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:05:56.741711 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d44774ec-0eaf-4282-953b-215fb518c464 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:56.742316 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d44774ec-0eaf-4282-953b-215fb518c464 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:56.749991 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d44774ec-0eaf-4282-953b-215fb518c464 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.749991 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d44774ec-0eaf-4282-953b-215fb518c464 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.752221 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d44774ec-0eaf-4282-953b-215fb518c464 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.752221 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d44774ec-0eaf-4282-953b-215fb518c464 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.799674 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3a2435f4-1b8a-4b16-842b-e4157fa21b89 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method VolumeAttachmentController.show of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ead760>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:56.800205 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3a2435f4-1b8a-4b16-842b-e4157fa21b89 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:56.807128 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a2435f4-1b8a-4b16-842b-e4157fa21b89 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.807778 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a2435f4-1b8a-4b16-842b-e4157fa21b89 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.814133 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a2435f4-1b8a-4b16-842b-e4157fa21b89 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.814133 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3a2435f4-1b8a-4b16-842b-e4157fa21b89 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.844614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3a2435f4-1b8a-4b16-842b-e4157fa21b89 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments/0274abb9-4df3-4fa4-8213-2604b742cf10" status: 200 len: 194 microversion: 2.1 time: 0.051721 Jul 25 06:05:56.845539 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 488/977] 10.222.0.40 () {58 vars in 1412 bytes} [Mon Jul 25 06:05:56 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments/0274abb9-4df3-4fa4-8213-2604b742cf10 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:56.858199 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-7a48471d-f957-4f53-8229-1f62c8cf793c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4880>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:56.858845 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-7a48471d-f957-4f53-8229-1f62c8cf793c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:56.865890 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7a48471d-f957-4f53-8229-1f62c8cf793c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.867307 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7a48471d-f957-4f53-8229-1f62c8cf793c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.868054 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7a48471d-f957-4f53-8229-1f62c8cf793c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:56.869079 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-7a48471d-f957-4f53-8229-1f62c8cf793c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:56.927308 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d44774ec-0eaf-4282-953b-215fb518c464 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:56.940486 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d44774ec-0eaf-4282-953b-215fb518c464 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:56.940486 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d44774ec-0eaf-4282-953b-215fb518c464 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:56.940486 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d44774ec-0eaf-4282-953b-215fb518c464 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1671 microversion: 2.20 time: 0.201380 Jul 25 06:05:56.940827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 490/978] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:56 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:05:56.964074 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-7a48471d-f957-4f53-8229-1f62c8cf793c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lazy-loading 'services' on Instance uuid bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:05:57.156643 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4052449a-4c5b-44bc-82da-587971039f3b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:57.157759 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4052449a-4c5b-44bc-82da-587971039f3b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:57.220395 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4052449a-4c5b-44bc-82da-587971039f3b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:57.220395 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4052449a-4c5b-44bc-82da-587971039f3b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:57.221279 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4052449a-4c5b-44bc-82da-587971039f3b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:57.221721 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4052449a-4c5b-44bc-82da-587971039f3b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:57.253901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4052449a-4c5b-44bc-82da-587971039f3b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101370 Jul 25 06:05:57.254459 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 491/979] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:05:57 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:05:57.264934 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-321f4250-1fdc-4608-a2d3-0d4e176a1266 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4850>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:57.265415 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-321f4250-1fdc-4608-a2d3-0d4e176a1266 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:57.271573 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-321f4250-1fdc-4608-a2d3-0d4e176a1266 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:57.272014 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-321f4250-1fdc-4608-a2d3-0d4e176a1266 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:57.272821 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-321f4250-1fdc-4608-a2d3-0d4e176a1266 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:57.274963 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-321f4250-1fdc-4608-a2d3-0d4e176a1266 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:57.306639 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-7a48471d-f957-4f53-8229-1f62c8cf793c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments/0274abb9-4df3-4fa4-8213-2604b742cf10" status: 202 len: 0 microversion: 2.1 time: 0.452724 Jul 25 06:05:57.307253 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 489/980] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:05:56 2022] DELETE /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments/0274abb9-4df3-4fa4-8213-2604b742cf10 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:05:57.368083 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-321f4250-1fdc-4608-a2d3-0d4e176a1266 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] HTTP exception thrown: Instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a is not attached to volume 8bc82f01-3714-4a66-9651-bc7a87550a20 Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-321f4250-1fdc-4608-a2d3-0d4e176a1266 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Request method failure captured: Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: DELETE /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments/8bc82f01-3714-4a66-9651-bc7a87550a20 HTTP/1.1 Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jIKp7XGled5ctqHcc8-_yW8uGvmoQ0d9zIwol6Yi5YUYy_l-Eo4FU0Cm-hwFenWwGzzC7VJ3kS3oJIDv2GFiGRFb_7O6OAwCFn3LOu7x2RkmirgkGp1HbFce_M7ZED80QsHaxIPwsDvI-HLlU2r3C7aOF27tW4gilmxv92UblGbZgk Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: a18a468edefd401c835e7e368ac740e5 Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-TestMinimumBasicScenario-124943261 Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:05:57.375756 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:05:57.377287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a18a468edefd401c835e7e368ac740e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a18a468edefd401c835e7e368ac740e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a18a468edefd401c835e7e368ac740e5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a18a468edefd401c835e7e368ac740e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:05:57.377287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-TestMinimumBasicScenario-124943261 Jul 25 06:05:57.377287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: a18a468edefd401c835e7e368ac740e5 Jul 25 06:05:57.377287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-TestMinimumBasicScenario-124943261 Jul 25 06:05:57.377287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-TestMinimumBasicScenario-124943261-project Jul 25 06:05:57.377287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:05:57.377287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:05:57.377287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: e13b80595f1d4c8cb4522657c9a88cd6 Jul 25 06:05:57.377287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-TestMinimumBasicScenario-124943261-project Jul 25 06:05:57.377287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4850>> Jul 25 06:05:57.377287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a is not attached to volume 8bc82f01-3714-4a66-9651-bc7a87550a20 Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'server_id': '4c88e17a-19b8-4f75-bbe7-01c014030a3a', 'id': '8bc82f01-3714-4a66-9651-bc7a87550a20'} Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8bc82f01-3714-4a66-9651-bc7a87550a20. Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:05:57.378022 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a is not attached to volume 8bc82f01-3714-4a66-9651-bc7a87550a20 Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a is not attached to volume 8bc82f01-3714-4a66-9651-bc7a87550a20 Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:05:57.379357 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-321f4250-1fdc-4608-a2d3-0d4e176a1266 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Returning 404 to user: Instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a is not attached to volume 8bc82f01-3714-4a66-9651-bc7a87550a20 {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:05:57.391699 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-321f4250-1fdc-4608-a2d3-0d4e176a1266 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments/8bc82f01-3714-4a66-9651-bc7a87550a20" status: 404 len: 154 microversion: 2.1 time: 0.116274 Jul 25 06:05:57.391699 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 492/981] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:05:57 2022] DELETE /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a/os-volume_attachments/8bc82f01-3714-4a66-9651-bc7a87550a20 => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:05:57.958481 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5732d75e-097f-4f78-b0cc-10cc18765703 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:57.959239 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5732d75e-097f-4f78-b0cc-10cc18765703 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:57.966539 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5732d75e-097f-4f78-b0cc-10cc18765703 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:57.966972 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5732d75e-097f-4f78-b0cc-10cc18765703 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:57.967720 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5732d75e-097f-4f78-b0cc-10cc18765703 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:57.968170 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5732d75e-097f-4f78-b0cc-10cc18765703 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:58.114892 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5732d75e-097f-4f78-b0cc-10cc18765703 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:58.124250 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5732d75e-097f-4f78-b0cc-10cc18765703 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:58.125793 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5732d75e-097f-4f78-b0cc-10cc18765703 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:58.127156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5732d75e-097f-4f78-b0cc-10cc18765703 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1671 microversion: 2.20 time: 0.173138 Jul 25 06:05:58.127713 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 490/982] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:57 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:05:58.665593 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-68da776a-1aef-4342-94bd-e5421fe6c211 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:58.666089 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-68da776a-1aef-4342-94bd-e5421fe6c211 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:58.672886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-68da776a-1aef-4342-94bd-e5421fe6c211 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:58.673365 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-68da776a-1aef-4342-94bd-e5421fe6c211 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:58.674118 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-68da776a-1aef-4342-94bd-e5421fe6c211 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:58.674551 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-68da776a-1aef-4342-94bd-e5421fe6c211 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:58.700338 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-68da776a-1aef-4342-94bd-e5421fe6c211 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:05:58.703793 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:59.001383 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-68da776a-1aef-4342-94bd-e5421fe6c211 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 204 len: 0 microversion: 2.1 time: 0.340029 Jul 25 06:05:59.002003 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 493/983] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:05:58 2022] DELETE /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:05:59.010439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-50246f17-ee2f-42bf-bf47-7bcb99a6e61b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:59.011055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-50246f17-ee2f-42bf-bf47-7bcb99a6e61b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:59.017139 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-50246f17-ee2f-42bf-bf47-7bcb99a6e61b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:59.017582 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-50246f17-ee2f-42bf-bf47-7bcb99a6e61b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:59.018337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-50246f17-ee2f-42bf-bf47-7bcb99a6e61b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:59.018772 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-50246f17-ee2f-42bf-bf47-7bcb99a6e61b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:59.152175 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c70d645c-1471-475b-9f64-57fea9607560 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:59.153182 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c70d645c-1471-475b-9f64-57fea9607560 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:59.163444 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c70d645c-1471-475b-9f64-57fea9607560 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:59.164458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c70d645c-1471-475b-9f64-57fea9607560 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:59.169275 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c70d645c-1471-475b-9f64-57fea9607560 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:59.169275 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c70d645c-1471-475b-9f64-57fea9607560 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:59.275119 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-50246f17-ee2f-42bf-bf47-7bcb99a6e61b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:59.282787 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-50246f17-ee2f-42bf-bf47-7bcb99a6e61b tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1553 microversion: 2.1 time: 0.276386 Jul 25 06:05:59.283358 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 491/984] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:05:59 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1553 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:05:59.312931 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c70d645c-1471-475b-9f64-57fea9607560 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:59.321710 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c70d645c-1471-475b-9f64-57fea9607560 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:59.323248 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c70d645c-1471-475b-9f64-57fea9607560 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:05:59.324494 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c70d645c-1471-475b-9f64-57fea9607560 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.180644 Jul 25 06:05:59.325370 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 494/985] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:05:59 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:05:59.504618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-854082b9-cba7-4c73-b95b-653717f66fb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method VolumeAttachmentController.show of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ead760>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:59.505115 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-854082b9-cba7-4c73-b95b-653717f66fb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:59.513209 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-854082b9-cba7-4c73-b95b-653717f66fb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:59.513738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-854082b9-cba7-4c73-b95b-653717f66fb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:59.514622 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-854082b9-cba7-4c73-b95b-653717f66fb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:59.515156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-854082b9-cba7-4c73-b95b-653717f66fb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:59.550521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-854082b9-cba7-4c73-b95b-653717f66fb6 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments/8646e653-b711-4ffe-bd52-19f0d6911214" status: 200 len: 194 microversion: 2.1 time: 0.049909 Jul 25 06:05:59.552609 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 492/986] 10.222.0.40 () {58 vars in 1412 bytes} [Mon Jul 25 06:05:59 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments/8646e653-b711-4ffe-bd52-19f0d6911214 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:05:59.566671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-46e71155-eed9-427b-8fd2-a0caab1c672e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4850>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:05:59.567390 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-46e71155-eed9-427b-8fd2-a0caab1c672e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:05:59.575380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-46e71155-eed9-427b-8fd2-a0caab1c672e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:59.575998 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-46e71155-eed9-427b-8fd2-a0caab1c672e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:59.577136 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-46e71155-eed9-427b-8fd2-a0caab1c672e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:05:59.577797 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-46e71155-eed9-427b-8fd2-a0caab1c672e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:05:59.661538 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-46e71155-eed9-427b-8fd2-a0caab1c672e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lazy-loading 'services' on Instance uuid bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:05:59.851498 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-46e71155-eed9-427b-8fd2-a0caab1c672e tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments/8646e653-b711-4ffe-bd52-19f0d6911214" status: 202 len: 0 microversion: 2.1 time: 0.290153 Jul 25 06:05:59.852951 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 495/987] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:05:59 2022] DELETE /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments/8646e653-b711-4ffe-bd52-19f0d6911214 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:06:00.300313 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-836dccc7-9b6a-4952-b87a-6957d583862e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:00.301019 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-836dccc7-9b6a-4952-b87a-6957d583862e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:00.307855 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-836dccc7-9b6a-4952-b87a-6957d583862e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:00.308401 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-836dccc7-9b6a-4952-b87a-6957d583862e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:00.309154 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-836dccc7-9b6a-4952-b87a-6957d583862e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:00.309584 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-836dccc7-9b6a-4952-b87a-6957d583862e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:00.345986 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-75fae133-9eb2-4122-a824-b8b2adfb58e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:00.346676 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-75fae133-9eb2-4122-a824-b8b2adfb58e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:00.356004 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-75fae133-9eb2-4122-a824-b8b2adfb58e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:00.356515 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-75fae133-9eb2-4122-a824-b8b2adfb58e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:00.357289 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-75fae133-9eb2-4122-a824-b8b2adfb58e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:00.357724 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-75fae133-9eb2-4122-a824-b8b2adfb58e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:00.451870 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-836dccc7-9b6a-4952-b87a-6957d583862e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:00.454249 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:00.462774 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-836dccc7-9b6a-4952-b87a-6957d583862e tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1553 microversion: 2.1 time: 0.166089 Jul 25 06:06:00.463352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 493/988] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:00 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:00.501801 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-75fae133-9eb2-4122-a824-b8b2adfb58e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:00.510164 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-75fae133-9eb2-4122-a824-b8b2adfb58e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:00.511653 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-75fae133-9eb2-4122-a824-b8b2adfb58e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:00.512833 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-75fae133-9eb2-4122-a824-b8b2adfb58e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.171062 Jul 25 06:06:00.522322 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 496/989] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:00 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:06:01.482680 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-95ea69ee-af25-4ac3-b9a5-b3c0a4039fbc tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:01.483382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-95ea69ee-af25-4ac3-b9a5-b3c0a4039fbc tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:01.492005 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95ea69ee-af25-4ac3-b9a5-b3c0a4039fbc tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:01.493484 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95ea69ee-af25-4ac3-b9a5-b3c0a4039fbc tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:01.494512 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95ea69ee-af25-4ac3-b9a5-b3c0a4039fbc tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:01.495185 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95ea69ee-af25-4ac3-b9a5-b3c0a4039fbc tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:01.531272 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f2d414b0-2561-4fb3-bcd6-cc8d466f6ba4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:01.532190 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f2d414b0-2561-4fb3-bcd6-cc8d466f6ba4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:01.539762 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2d414b0-2561-4fb3-bcd6-cc8d466f6ba4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:01.540244 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2d414b0-2561-4fb3-bcd6-cc8d466f6ba4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:01.541037 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2d414b0-2561-4fb3-bcd6-cc8d466f6ba4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:01.541475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f2d414b0-2561-4fb3-bcd6-cc8d466f6ba4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:01.682344 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f2d414b0-2561-4fb3-bcd6-cc8d466f6ba4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:01.692476 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f2d414b0-2561-4fb3-bcd6-cc8d466f6ba4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:01.694018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f2d414b0-2561-4fb3-bcd6-cc8d466f6ba4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:01.695190 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f2d414b0-2561-4fb3-bcd6-cc8d466f6ba4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.168149 Jul 25 06:06:01.705912 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 497/990] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:01 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:06:01.854475 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-95ea69ee-af25-4ac3-b9a5-b3c0a4039fbc tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:01.863488 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-95ea69ee-af25-4ac3-b9a5-b3c0a4039fbc tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1553 microversion: 2.1 time: 0.385165 Jul 25 06:06:01.872795 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 494/991] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:01 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1553 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:02.074670 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8bf24590-6456-4afa-a5b0-5c2c0dde4dde tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:02.080733 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-8bf24590-6456-4afa-a5b0-5c2c0dde4dde tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:02.082263 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8bf24590-6456-4afa-a5b0-5c2c0dde4dde tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:02.082716 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8bf24590-6456-4afa-a5b0-5c2c0dde4dde tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:02.083475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8bf24590-6456-4afa-a5b0-5c2c0dde4dde tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:02.083914 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8bf24590-6456-4afa-a5b0-5c2c0dde4dde tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:02.115322 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8bf24590-6456-4afa-a5b0-5c2c0dde4dde tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044871 Jul 25 06:06:02.115905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 498/992] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:06:02 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:06:02.257166 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-39bf66cc-fd80-4984-bc0a-a84fc13c9734 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:02.257166 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-39bf66cc-fd80-4984-bc0a-a84fc13c9734 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:02.268357 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-39bf66cc-fd80-4984-bc0a-a84fc13c9734 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:02.268669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-39bf66cc-fd80-4984-bc0a-a84fc13c9734 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:02.269427 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-39bf66cc-fd80-4984-bc0a-a84fc13c9734 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:02.269918 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-39bf66cc-fd80-4984-bc0a-a84fc13c9734 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:02.270926 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-822676e5-68e0-4456-89d0-ab96762637b3 req-9fd6778b-2367-4cd1-ba54-197f712bbacf service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "4c88e17a-19b8-4f75-bbe7-01c014030a3a", "name": "network-vif-deleted", "tag": "279fa404-535f-4110-9863-de45be0f04f9"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:02.284073 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-822676e5-68e0-4456-89d0-ab96762637b3 req-9fd6778b-2367-4cd1-ba54-197f712bbacf service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:02.284825 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-822676e5-68e0-4456-89d0-ab96762637b3 req-9fd6778b-2367-4cd1-ba54-197f712bbacf service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:02.298085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-822676e5-68e0-4456-89d0-ab96762637b3 req-9fd6778b-2367-4cd1-ba54-197f712bbacf service nova] Creating event network-vif-deleted:279fa404-535f-4110-9863-de45be0f04f9 for instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a on hv-cinder-84841 Jul 25 06:06:02.304166 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-822676e5-68e0-4456-89d0-ab96762637b3 req-9fd6778b-2367-4cd1-ba54-197f712bbacf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036562 Jul 25 06:06:02.305561 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 499/993] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:02.327237 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-39bf66cc-fd80-4984-bc0a-a84fc13c9734 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080167 Jul 25 06:06:02.335506 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 495/994] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:06:02 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 06:06:02.413544 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c450022b-ef55-4b5b-a719-3b3a85ec8941 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:02.416693 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c450022b-ef55-4b5b-a719-3b3a85ec8941 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:02.429080 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c450022b-ef55-4b5b-a719-3b3a85ec8941 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:02.431800 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c450022b-ef55-4b5b-a719-3b3a85ec8941 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:02.433380 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c450022b-ef55-4b5b-a719-3b3a85ec8941 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:02.433871 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c450022b-ef55-4b5b-a719-3b3a85ec8941 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:02.500660 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c450022b-ef55-4b5b-a719-3b3a85ec8941 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:06:02.715050 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e51e658d-b042-4d84-a102-1549537a08d8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:02.716455 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e51e658d-b042-4d84-a102-1549537a08d8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:02.727310 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e51e658d-b042-4d84-a102-1549537a08d8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:02.728464 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e51e658d-b042-4d84-a102-1549537a08d8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:02.729569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e51e658d-b042-4d84-a102-1549537a08d8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:02.730298 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e51e658d-b042-4d84-a102-1549537a08d8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:02.795741 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c450022b-ef55-4b5b-a719-3b3a85ec8941 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 204 len: 0 microversion: 2.1 time: 0.389643 Jul 25 06:06:02.796518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 500/995] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:06:02 2022] DELETE /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:06:02.810068 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2ba2fc9d-aa15-4e78-b0c1-fa594331377f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:02.810943 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2ba2fc9d-aa15-4e78-b0c1-fa594331377f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:02.817805 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ba2fc9d-aa15-4e78-b0c1-fa594331377f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:02.818347 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ba2fc9d-aa15-4e78-b0c1-fa594331377f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:02.819267 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ba2fc9d-aa15-4e78-b0c1-fa594331377f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:02.819875 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2ba2fc9d-aa15-4e78-b0c1-fa594331377f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:02.999515 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2ba2fc9d-aa15-4e78-b0c1-fa594331377f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:03.009068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e51e658d-b042-4d84-a102-1549537a08d8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:03.011492 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2ba2fc9d-aa15-4e78-b0c1-fa594331377f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1675 microversion: 2.1 time: 0.208605 Jul 25 06:06:03.024566 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 501/996] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:02 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:03.030102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ccd9eb9f-83bd-491c-bdfb-c9007dae5911 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:03.031178 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ccd9eb9f-83bd-491c-bdfb-c9007dae5911 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:03.040199 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ccd9eb9f-83bd-491c-bdfb-c9007dae5911 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:03.041207 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ccd9eb9f-83bd-491c-bdfb-c9007dae5911 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:03.042848 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ccd9eb9f-83bd-491c-bdfb-c9007dae5911 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:03.044460 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ccd9eb9f-83bd-491c-bdfb-c9007dae5911 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:03.049062 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e51e658d-b042-4d84-a102-1549537a08d8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:03.051833 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-e51e658d-b042-4d84-a102-1549537a08d8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:03.056658 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e51e658d-b042-4d84-a102-1549537a08d8 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.347025 Jul 25 06:06:03.081657 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 496/997] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:02 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:06:03.104574 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ccd9eb9f-83bd-491c-bdfb-c9007dae5911 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:03.105399 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ccd9eb9f-83bd-491c-bdfb-c9007dae5911 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:03.106021 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-ccd9eb9f-83bd-491c-bdfb-c9007dae5911 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lazy-loading 'fault' on Instance uuid 4c88e17a-19b8-4f75-bbe7-01c014030a3a {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:03.158180 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ccd9eb9f-83bd-491c-bdfb-c9007dae5911 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:03.171800 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ccd9eb9f-83bd-491c-bdfb-c9007dae5911 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1348 microversion: 2.1 time: 0.145689 Jul 25 06:06:03.182382 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 502/998] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:03 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1348 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:04.029763 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5c4f1d5d-572d-42d0-84cf-b82b230a5f3f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:04.030376 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5c4f1d5d-572d-42d0-84cf-b82b230a5f3f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:04.037248 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5c4f1d5d-572d-42d0-84cf-b82b230a5f3f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:04.037672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5c4f1d5d-572d-42d0-84cf-b82b230a5f3f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:04.038421 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5c4f1d5d-572d-42d0-84cf-b82b230a5f3f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:04.038851 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5c4f1d5d-572d-42d0-84cf-b82b230a5f3f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:04.080219 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-80c7c8cf-c332-41c2-9d19-3a61fdd36b3e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:04.080805 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-80c7c8cf-c332-41c2-9d19-3a61fdd36b3e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:04.088523 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-80c7c8cf-c332-41c2-9d19-3a61fdd36b3e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:04.088987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-80c7c8cf-c332-41c2-9d19-3a61fdd36b3e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:04.089739 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-80c7c8cf-c332-41c2-9d19-3a61fdd36b3e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:04.090170 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-80c7c8cf-c332-41c2-9d19-3a61fdd36b3e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:04.182022 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5c4f1d5d-572d-42d0-84cf-b82b230a5f3f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:04.195155 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5c4f1d5d-572d-42d0-84cf-b82b230a5f3f tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1675 microversion: 2.1 time: 0.164973 Jul 25 06:06:04.195155 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 497/999] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:04 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:04.197188 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d66f1a8f-aa43-44e5-9ac1-b3fc3b9db3b0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:04.197801 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d66f1a8f-aa43-44e5-9ac1-b3fc3b9db3b0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:04.204088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d66f1a8f-aa43-44e5-9ac1-b3fc3b9db3b0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:04.204569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d66f1a8f-aa43-44e5-9ac1-b3fc3b9db3b0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:04.205650 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d66f1a8f-aa43-44e5-9ac1-b3fc3b9db3b0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:04.206094 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d66f1a8f-aa43-44e5-9ac1-b3fc3b9db3b0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:04.235201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-80c7c8cf-c332-41c2-9d19-3a61fdd36b3e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:04.240523 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d66f1a8f-aa43-44e5-9ac1-b3fc3b9db3b0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:04.241170 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d66f1a8f-aa43-44e5-9ac1-b3fc3b9db3b0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:04.241890 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-d66f1a8f-aa43-44e5-9ac1-b3fc3b9db3b0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lazy-loading 'fault' on Instance uuid 4c88e17a-19b8-4f75-bbe7-01c014030a3a {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:04.246277 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-80c7c8cf-c332-41c2-9d19-3a61fdd36b3e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:04.248209 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-80c7c8cf-c332-41c2-9d19-3a61fdd36b3e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:04.249381 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-80c7c8cf-c332-41c2-9d19-3a61fdd36b3e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.173137 Jul 25 06:06:04.250081 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 503/1000] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:04 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:06:04.286235 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d66f1a8f-aa43-44e5-9ac1-b3fc3b9db3b0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:04.294564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d66f1a8f-aa43-44e5-9ac1-b3fc3b9db3b0 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1348 microversion: 2.1 time: 0.101700 Jul 25 06:06:04.295142 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 498/1001] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:04 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:05.210531 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-890fe4e0-ec58-40ca-a6bd-82c939e384ed tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:05.213157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-890fe4e0-ec58-40ca-a6bd-82c939e384ed tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:05.220700 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-890fe4e0-ec58-40ca-a6bd-82c939e384ed tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.221745 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-890fe4e0-ec58-40ca-a6bd-82c939e384ed tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.222527 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-890fe4e0-ec58-40ca-a6bd-82c939e384ed tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.222961 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-890fe4e0-ec58-40ca-a6bd-82c939e384ed tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.268417 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9c80d7f1-533e-4191-926f-354387caeac3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:05.269722 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9c80d7f1-533e-4191-926f-354387caeac3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:05.282999 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9c80d7f1-533e-4191-926f-354387caeac3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.283429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9c80d7f1-533e-4191-926f-354387caeac3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.284237 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9c80d7f1-533e-4191-926f-354387caeac3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.284675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9c80d7f1-533e-4191-926f-354387caeac3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.452817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9c80d7f1-533e-4191-926f-354387caeac3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:05.471363 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9c80d7f1-533e-4191-926f-354387caeac3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:05.472927 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9c80d7f1-533e-4191-926f-354387caeac3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:05.474110 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9c80d7f1-533e-4191-926f-354387caeac3 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.209843 Jul 25 06:06:05.485117 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 499/1002] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:05 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:05.485774 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8c1ab601-d75e-43f1-9d2c-f377c96ae6ab tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:05.486385 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8c1ab601-d75e-43f1-9d2c-f377c96ae6ab tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:05.489418 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-890fe4e0-ec58-40ca-a6bd-82c939e384ed tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:05.499616 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-890fe4e0-ec58-40ca-a6bd-82c939e384ed tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1675 microversion: 2.1 time: 0.292970 Jul 25 06:06:05.500557 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 504/1003] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:05 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1675 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:05.502695 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8c1ab601-d75e-43f1-9d2c-f377c96ae6ab tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.503144 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8c1ab601-d75e-43f1-9d2c-f377c96ae6ab tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.503916 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8c1ab601-d75e-43f1-9d2c-f377c96ae6ab tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.504374 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8c1ab601-d75e-43f1-9d2c-f377c96ae6ab tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.569194 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8c1ab601-d75e-43f1-9d2c-f377c96ae6ab tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:05.569638 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8c1ab601-d75e-43f1-9d2c-f377c96ae6ab tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:05.570111 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-8c1ab601-d75e-43f1-9d2c-f377c96ae6ab tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lazy-loading 'fault' on Instance uuid 4c88e17a-19b8-4f75-bbe7-01c014030a3a {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:05.626209 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8c1ab601-d75e-43f1-9d2c-f377c96ae6ab tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:05.634483 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8c1ab601-d75e-43f1-9d2c-f377c96ae6ab tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1348 microversion: 2.1 time: 0.158334 Jul 25 06:06:05.635066 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 500/1004] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:05 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1348 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:06.495885 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-091bc4a2-8ec4-46f4-9db0-6a4b1ad2cf61 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:06.500083 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-091bc4a2-8ec4-46f4-9db0-6a4b1ad2cf61 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:06.504803 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-091bc4a2-8ec4-46f4-9db0-6a4b1ad2cf61 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:06.505250 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-091bc4a2-8ec4-46f4-9db0-6a4b1ad2cf61 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:06.506100 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-091bc4a2-8ec4-46f4-9db0-6a4b1ad2cf61 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:06.506594 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-091bc4a2-8ec4-46f4-9db0-6a4b1ad2cf61 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:06.519262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-41454b55-40c6-4728-8665-1b3f91eb82f2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:06.520809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-41454b55-40c6-4728-8665-1b3f91eb82f2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:06.532775 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-41454b55-40c6-4728-8665-1b3f91eb82f2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:06.533430 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-41454b55-40c6-4728-8665-1b3f91eb82f2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:06.534546 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-41454b55-40c6-4728-8665-1b3f91eb82f2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:06.535060 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-41454b55-40c6-4728-8665-1b3f91eb82f2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:06.720271 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-091bc4a2-8ec4-46f4-9db0-6a4b1ad2cf61 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:06.734355 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-41454b55-40c6-4728-8665-1b3f91eb82f2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:06.745153 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-41454b55-40c6-4728-8665-1b3f91eb82f2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1675 microversion: 2.1 time: 0.230901 Jul 25 06:06:06.746304 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-091bc4a2-8ec4-46f4-9db0-6a4b1ad2cf61 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:06.749314 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-091bc4a2-8ec4-46f4-9db0-6a4b1ad2cf61 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:06.759748 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 501/1005] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:06 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:06.760003 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-091bc4a2-8ec4-46f4-9db0-6a4b1ad2cf61 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.265337 Jul 25 06:06:06.760650 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 505/1006] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:06 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:06.769354 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-dff9f326-a9bd-4004-9e71-bd6457cc18f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:06.770275 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-dff9f326-a9bd-4004-9e71-bd6457cc18f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:06.779254 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dff9f326-a9bd-4004-9e71-bd6457cc18f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:06.780034 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dff9f326-a9bd-4004-9e71-bd6457cc18f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:06.781051 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dff9f326-a9bd-4004-9e71-bd6457cc18f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:06.781706 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dff9f326-a9bd-4004-9e71-bd6457cc18f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:06.819591 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dff9f326-a9bd-4004-9e71-bd6457cc18f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:06.821657 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dff9f326-a9bd-4004-9e71-bd6457cc18f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:06.822620 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-dff9f326-a9bd-4004-9e71-bd6457cc18f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lazy-loading 'fault' on Instance uuid 4c88e17a-19b8-4f75-bbe7-01c014030a3a {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:06.870583 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-dff9f326-a9bd-4004-9e71-bd6457cc18f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:06.879353 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-dff9f326-a9bd-4004-9e71-bd6457cc18f2 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1348 microversion: 2.1 time: 0.128600 Jul 25 06:06:06.880100 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 502/1007] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:06 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1348 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:07.767300 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-773f7e7b-949e-4317-8e0e-0862de1daab4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:07.768957 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-773f7e7b-949e-4317-8e0e-0862de1daab4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:07.779487 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-13e9e939-3ee0-4fc2-975f-478f684f48d0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:07.781151 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-13e9e939-3ee0-4fc2-975f-478f684f48d0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:07.787916 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-13e9e939-3ee0-4fc2-975f-478f684f48d0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:07.788531 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-773f7e7b-949e-4317-8e0e-0862de1daab4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:07.789113 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-13e9e939-3ee0-4fc2-975f-478f684f48d0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:07.789795 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-773f7e7b-949e-4317-8e0e-0862de1daab4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:07.791158 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-13e9e939-3ee0-4fc2-975f-478f684f48d0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:07.791859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-13e9e939-3ee0-4fc2-975f-478f684f48d0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:07.794058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-773f7e7b-949e-4317-8e0e-0862de1daab4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:07.794555 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-773f7e7b-949e-4317-8e0e-0862de1daab4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:07.969790 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-773f7e7b-949e-4317-8e0e-0862de1daab4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:07.972581 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:07.985971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-773f7e7b-949e-4317-8e0e-0862de1daab4 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1675 microversion: 2.1 time: 0.222894 Jul 25 06:06:07.997250 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-13e9e939-3ee0-4fc2-975f-478f684f48d0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:08.004057 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 506/1008] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:07 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:08.004057 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-43ae3f84-c253-4572-9a68-091d675abea5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:08.004057 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-43ae3f84-c253-4572-9a68-091d675abea5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:08.004765 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-13e9e939-3ee0-4fc2-975f-478f684f48d0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:08.004765 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-13e9e939-3ee0-4fc2-975f-478f684f48d0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:08.005665 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-13e9e939-3ee0-4fc2-975f-478f684f48d0 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.230353 Jul 25 06:06:08.006386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 503/1009] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:07 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:08.016952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-43ae3f84-c253-4572-9a68-091d675abea5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:08.016952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-43ae3f84-c253-4572-9a68-091d675abea5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:08.016952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-43ae3f84-c253-4572-9a68-091d675abea5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:08.016952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-43ae3f84-c253-4572-9a68-091d675abea5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:08.069993 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-43ae3f84-c253-4572-9a68-091d675abea5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:08.070482 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-43ae3f84-c253-4572-9a68-091d675abea5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:08.070945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-43ae3f84-c253-4572-9a68-091d675abea5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lazy-loading 'fault' on Instance uuid 4c88e17a-19b8-4f75-bbe7-01c014030a3a {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:08.116162 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-43ae3f84-c253-4572-9a68-091d675abea5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:08.124324 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-43ae3f84-c253-4572-9a68-091d675abea5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1348 microversion: 2.1 time: 0.127508 Jul 25 06:06:08.124905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 507/1010] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:07 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1348 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:09.005648 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-743ea0cf-9ae0-455e-b046-7c2e5718c9ee tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:09.007183 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-743ea0cf-9ae0-455e-b046-7c2e5718c9ee tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:09.014780 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-743ea0cf-9ae0-455e-b046-7c2e5718c9ee tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:09.017524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-743ea0cf-9ae0-455e-b046-7c2e5718c9ee tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:09.017524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-743ea0cf-9ae0-455e-b046-7c2e5718c9ee tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:09.017524 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-743ea0cf-9ae0-455e-b046-7c2e5718c9ee tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:09.024733 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8bf519ba-d21c-41a9-8aae-97463b64a3e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:09.026293 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-8bf519ba-d21c-41a9-8aae-97463b64a3e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:09.033955 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8bf519ba-d21c-41a9-8aae-97463b64a3e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:09.034749 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8bf519ba-d21c-41a9-8aae-97463b64a3e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:09.036058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8bf519ba-d21c-41a9-8aae-97463b64a3e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:09.036760 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8bf519ba-d21c-41a9-8aae-97463b64a3e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:09.186204 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-743ea0cf-9ae0-455e-b046-7c2e5718c9ee tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:09.201062 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-743ea0cf-9ae0-455e-b046-7c2e5718c9ee tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1675 microversion: 2.1 time: 0.199302 Jul 25 06:06:09.201434 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 504/1011] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:09 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:09.215418 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-88bbf1a8-e726-45a0-83ab-d12cb62c4d3d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:09.216219 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-88bbf1a8-e726-45a0-83ab-d12cb62c4d3d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:09.223834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88bbf1a8-e726-45a0-83ab-d12cb62c4d3d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:09.227021 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88bbf1a8-e726-45a0-83ab-d12cb62c4d3d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:09.227021 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88bbf1a8-e726-45a0-83ab-d12cb62c4d3d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:09.227021 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88bbf1a8-e726-45a0-83ab-d12cb62c4d3d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:09.229964 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8bf519ba-d21c-41a9-8aae-97463b64a3e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:09.240460 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8bf519ba-d21c-41a9-8aae-97463b64a3e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:09.242843 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8bf519ba-d21c-41a9-8aae-97463b64a3e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:09.244837 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8bf519ba-d21c-41a9-8aae-97463b64a3e6 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.224676 Jul 25 06:06:09.245667 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 508/1012] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:09 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:06:09.283897 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88bbf1a8-e726-45a0-83ab-d12cb62c4d3d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:09.284874 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-88bbf1a8-e726-45a0-83ab-d12cb62c4d3d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:09.285337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-88bbf1a8-e726-45a0-83ab-d12cb62c4d3d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lazy-loading 'fault' on Instance uuid 4c88e17a-19b8-4f75-bbe7-01c014030a3a {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:09.336706 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-88bbf1a8-e726-45a0-83ab-d12cb62c4d3d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:09.344430 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-88bbf1a8-e726-45a0-83ab-d12cb62c4d3d tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1348 microversion: 2.1 time: 0.141991 Jul 25 06:06:09.345671 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 505/1013] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:09 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1348 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:10.218069 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-76e8f446-0508-4e95-a3ae-d35d0c393196 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:10.218704 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-76e8f446-0508-4e95-a3ae-d35d0c393196 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:10.225359 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-76e8f446-0508-4e95-a3ae-d35d0c393196 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:10.225810 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-76e8f446-0508-4e95-a3ae-d35d0c393196 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:10.227249 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-76e8f446-0508-4e95-a3ae-d35d0c393196 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:10.227693 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-76e8f446-0508-4e95-a3ae-d35d0c393196 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:10.263977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-46c1b0ac-a040-4d9c-a524-f37f923a4509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:10.264625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-46c1b0ac-a040-4d9c-a524-f37f923a4509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:10.273271 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-46c1b0ac-a040-4d9c-a524-f37f923a4509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:10.274859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-46c1b0ac-a040-4d9c-a524-f37f923a4509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:10.275710 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-46c1b0ac-a040-4d9c-a524-f37f923a4509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:10.276169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-46c1b0ac-a040-4d9c-a524-f37f923a4509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:10.402899 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-76e8f446-0508-4e95-a3ae-d35d0c393196 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:10.411683 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-76e8f446-0508-4e95-a3ae-d35d0c393196 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1675 microversion: 2.1 time: 0.197381 Jul 25 06:06:10.418102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 509/1014] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:10 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:10.423292 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-42d467e4-727d-4cd7-80d4-797e31fe5427 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:10.424084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-42d467e4-727d-4cd7-80d4-797e31fe5427 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:10.433425 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-42d467e4-727d-4cd7-80d4-797e31fe5427 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:10.433425 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-42d467e4-727d-4cd7-80d4-797e31fe5427 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:10.433425 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-42d467e4-727d-4cd7-80d4-797e31fe5427 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:10.433425 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-42d467e4-727d-4cd7-80d4-797e31fe5427 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:10.465543 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-42d467e4-727d-4cd7-80d4-797e31fe5427 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:10.465987 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-42d467e4-727d-4cd7-80d4-797e31fe5427 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:10.466436 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-42d467e4-727d-4cd7-80d4-797e31fe5427 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lazy-loading 'fault' on Instance uuid 4c88e17a-19b8-4f75-bbe7-01c014030a3a {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:10.466926 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-46c1b0ac-a040-4d9c-a524-f37f923a4509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:10.474824 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-46c1b0ac-a040-4d9c-a524-f37f923a4509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:10.476389 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-46c1b0ac-a040-4d9c-a524-f37f923a4509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:10.477739 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-46c1b0ac-a040-4d9c-a524-f37f923a4509 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.217625 Jul 25 06:06:10.480154 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 506/1015] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:10 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:10.510010 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-42d467e4-727d-4cd7-80d4-797e31fe5427 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:10.518204 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-42d467e4-727d-4cd7-80d4-797e31fe5427 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1348 microversion: 2.1 time: 0.098765 Jul 25 06:06:10.518779 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 510/1016] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:10 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:11.429215 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3821320c-627c-46a8-8bf3-70005bd3063d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:11.430476 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3821320c-627c-46a8-8bf3-70005bd3063d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:11.437130 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3821320c-627c-46a8-8bf3-70005bd3063d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:11.437586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3821320c-627c-46a8-8bf3-70005bd3063d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:11.438358 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3821320c-627c-46a8-8bf3-70005bd3063d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:11.438798 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3821320c-627c-46a8-8bf3-70005bd3063d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:11.494963 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6b7421cf-d933-453c-8f71-8c982597f3ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:11.495644 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6b7421cf-d933-453c-8f71-8c982597f3ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:11.502354 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b7421cf-d933-453c-8f71-8c982597f3ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:11.502808 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b7421cf-d933-453c-8f71-8c982597f3ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:11.503574 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b7421cf-d933-453c-8f71-8c982597f3ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:11.504005 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6b7421cf-d933-453c-8f71-8c982597f3ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:11.586742 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3821320c-627c-46a8-8bf3-70005bd3063d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:11.601033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3821320c-627c-46a8-8bf3-70005bd3063d tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1675 microversion: 2.1 time: 0.169339 Jul 25 06:06:11.601033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 507/1017] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:11 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:11.601033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d0e64097-df7d-426a-b805-d3bfed7fc1a9 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:11.601033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d0e64097-df7d-426a-b805-d3bfed7fc1a9 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:11.607429 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0e64097-df7d-426a-b805-d3bfed7fc1a9 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:11.608019 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0e64097-df7d-426a-b805-d3bfed7fc1a9 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:11.608918 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0e64097-df7d-426a-b805-d3bfed7fc1a9 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:11.609433 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0e64097-df7d-426a-b805-d3bfed7fc1a9 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:11.641840 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6b7421cf-d933-453c-8f71-8c982597f3ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:11.643351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0e64097-df7d-426a-b805-d3bfed7fc1a9 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:11.643815 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d0e64097-df7d-426a-b805-d3bfed7fc1a9 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:11.644301 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-d0e64097-df7d-426a-b805-d3bfed7fc1a9 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lazy-loading 'fault' on Instance uuid 4c88e17a-19b8-4f75-bbe7-01c014030a3a {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:11.650589 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6b7421cf-d933-453c-8f71-8c982597f3ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:11.652144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6b7421cf-d933-453c-8f71-8c982597f3ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:11.653303 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6b7421cf-d933-453c-8f71-8c982597f3ad tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.162333 Jul 25 06:06:11.656697 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 511/1018] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:11 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:06:11.687960 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d0e64097-df7d-426a-b805-d3bfed7fc1a9 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:11.690244 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=100 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:11.696969 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d0e64097-df7d-426a-b805-d3bfed7fc1a9 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1348 microversion: 2.1 time: 0.100758 Jul 25 06:06:11.697534 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 508/1019] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:11 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:12.613995 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-5c208370-7783-4518-8909-1d743a92111a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:12.614605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-5c208370-7783-4518-8909-1d743a92111a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:12.621499 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5c208370-7783-4518-8909-1d743a92111a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:12.621952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5c208370-7783-4518-8909-1d743a92111a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:12.622722 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5c208370-7783-4518-8909-1d743a92111a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:12.623154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-5c208370-7783-4518-8909-1d743a92111a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:12.674391 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5a749a74-72d6-4723-a257-a4b1f6aca72e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:12.674997 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5a749a74-72d6-4723-a257-a4b1f6aca72e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:12.683759 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5a749a74-72d6-4723-a257-a4b1f6aca72e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:12.684158 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5a749a74-72d6-4723-a257-a4b1f6aca72e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:12.685075 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5a749a74-72d6-4723-a257-a4b1f6aca72e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:12.685510 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5a749a74-72d6-4723-a257-a4b1f6aca72e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:12.777998 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-5c208370-7783-4518-8909-1d743a92111a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:12.786077 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-5c208370-7783-4518-8909-1d743a92111a tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1675 microversion: 2.1 time: 0.176028 Jul 25 06:06:12.786591 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 512/1020] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:12 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:12.795758 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7b807c2b-2bff-4b6a-9911-c891537a75c5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:12.795758 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7b807c2b-2bff-4b6a-9911-c891537a75c5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:12.800433 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b807c2b-2bff-4b6a-9911-c891537a75c5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:12.800433 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b807c2b-2bff-4b6a-9911-c891537a75c5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:12.800433 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b807c2b-2bff-4b6a-9911-c891537a75c5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:12.800880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b807c2b-2bff-4b6a-9911-c891537a75c5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:12.823669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5a749a74-72d6-4723-a257-a4b1f6aca72e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:12.832093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5a749a74-72d6-4723-a257-a4b1f6aca72e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:12.833082 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b807c2b-2bff-4b6a-9911-c891537a75c5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:12.833496 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b807c2b-2bff-4b6a-9911-c891537a75c5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:12.833857 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5a749a74-72d6-4723-a257-a4b1f6aca72e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:12.833986 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-7b807c2b-2bff-4b6a-9911-c891537a75c5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lazy-loading 'fault' on Instance uuid 4c88e17a-19b8-4f75-bbe7-01c014030a3a {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:12.835128 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5a749a74-72d6-4723-a257-a4b1f6aca72e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.164938 Jul 25 06:06:12.835922 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 509/1021] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:12 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:06:12.875525 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7b807c2b-2bff-4b6a-9911-c891537a75c5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b80595f1d4c8cb4522657c9a88cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a468edefd401c835e7e368ac740e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:12.883650 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7b807c2b-2bff-4b6a-9911-c891537a75c5 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 200 len: 1348 microversion: 2.1 time: 0.095577 Jul 25 06:06:12.884342 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 513/1022] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:12 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:13.547601 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0d63658c-1781-40b8-b06a-a4d8bf1942fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method IPsController.index of <nova.api.openstack.compute.ips.IPsController object at 0x7f6533eed040>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:13.548241 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0d63658c-1781-40b8-b06a-a4d8bf1942fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:13.554697 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d63658c-1781-40b8-b06a-a4d8bf1942fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:13.555720 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d63658c-1781-40b8-b06a-a4d8bf1942fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:13.556539 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d63658c-1781-40b8-b06a-a4d8bf1942fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:13.556983 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0d63658c-1781-40b8-b06a-a4d8bf1942fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:13.581570 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0d63658c-1781-40b8-b06a-a4d8bf1942fd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/ips" status: 200 len: 149 microversion: 2.1 time: 0.037833 Jul 25 06:06:13.582165 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 510/1023] 10.222.0.40 () {58 vars in 1247 bytes} [Mon Jul 25 06:06:13 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:13.802982 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7b174843-5acc-4fc7-9044-fae20e09c5b0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:13.803588 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7b174843-5acc-4fc7-9044-fae20e09c5b0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:13.810588 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b174843-5acc-4fc7-9044-fae20e09c5b0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:13.811042 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b174843-5acc-4fc7-9044-fae20e09c5b0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:13.811814 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b174843-5acc-4fc7-9044-fae20e09c5b0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:13.812296 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7b174843-5acc-4fc7-9044-fae20e09c5b0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:13.855667 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-dacec752-fe76-4965-abb0-c3da9b9d8278 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:13.858906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-dacec752-fe76-4965-abb0-c3da9b9d8278 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:13.864712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dacec752-fe76-4965-abb0-c3da9b9d8278 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:13.865938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dacec752-fe76-4965-abb0-c3da9b9d8278 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:13.867358 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dacec752-fe76-4965-abb0-c3da9b9d8278 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:13.868103 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-dacec752-fe76-4965-abb0-c3da9b9d8278 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:13.894033 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7b174843-5acc-4fc7-9044-fae20e09c5b0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:13.903133 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7b174843-5acc-4fc7-9044-fae20e09c5b0 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1608 microversion: 2.1 time: 0.104103 Jul 25 06:06:13.906137 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 514/1024] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:13 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1608 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:13.910726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-7a7d5120-ce7d-43dd-b26a-049903163aa2 req-3b238c4d-c054-438d-95e4-046f6c6efed9 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b", "name": "network-vif-deleted", "tag": "4c6f1034-2014-4ea0-93a6-b1cb240056db"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:13.919994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-7a7d5120-ce7d-43dd-b26a-049903163aa2 req-3b238c4d-c054-438d-95e4-046f6c6efed9 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:13.920490 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-7a7d5120-ce7d-43dd-b26a-049903163aa2 req-3b238c4d-c054-438d-95e4-046f6c6efed9 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:13.932347 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-7a7d5120-ce7d-43dd-b26a-049903163aa2 req-3b238c4d-c054-438d-95e4-046f6c6efed9 service nova] Creating event network-vif-deleted:4c6f1034-2014-4ea0-93a6-b1cb240056db for instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b on hv-cinder-84841 Jul 25 06:06:13.941266 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-7a7d5120-ce7d-43dd-b26a-049903163aa2 req-3b238c4d-c054-438d-95e4-046f6c6efed9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033928 Jul 25 06:06:13.942060 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 515/1025] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:13.949157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4c41c914-ad4c-41f0-833a-0ad305646b56 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:13.949157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4c41c914-ad4c-41f0-833a-0ad305646b56 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] [instance: 4c88e17a-19b8-4f75-bbe7-01c014030a3a] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:13.957590 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4c41c914-ad4c-41f0-833a-0ad305646b56 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:13.958338 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4c41c914-ad4c-41f0-833a-0ad305646b56 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:13.959293 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4c41c914-ad4c-41f0-833a-0ad305646b56 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:13.959891 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4c41c914-ad4c-41f0-833a-0ad305646b56 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:13.988032 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-4c41c914-ad4c-41f0-833a-0ad305646b56 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] HTTP exception thrown: Instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a could not be found. Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4c41c914-ad4c-41f0-833a-0ad305646b56 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Request method failure captured: Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a HTTP/1.1 Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jIKp7XGled5ctqHcc8-_yW8uGvmoQ0d9zIwol6Yi5YUYy_l-Eo4FU0Cm-hwFenWwGzzC7VJ3kS3oJIDv2GFiGRFb_7O6OAwCFn3LOu7x2RkmirgkGp1HbFce_M7ZED80QsHaxIPwsDvI-HLlU2r3C7aOF27tW4gilmxv92UblGbZgk Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: a18a468edefd401c835e7e368ac740e5 Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-TestMinimumBasicScenario-124943261 Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:06:13.991879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a18a468edefd401c835e7e368ac740e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a18a468edefd401c835e7e368ac740e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a18a468edefd401c835e7e368ac740e5", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a18a468edefd401c835e7e368ac740e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-TestMinimumBasicScenario-124943261 Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: a18a468edefd401c835e7e368ac740e5 Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-TestMinimumBasicScenario-124943261 Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-TestMinimumBasicScenario-124943261-project Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: e13b80595f1d4c8cb4522657c9a88cd6 Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-TestMinimumBasicScenario-124943261-project Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a could not be found. Jul 25 06:06:13.993720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': '4c88e17a-19b8-4f75-bbe7-01c014030a3a'} Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a could not be found. Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:13.994545 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a could not be found. Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a could not be found. Jul 25 06:06:13.995868 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:14.000611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4c41c914-ad4c-41f0-833a-0ad305646b56 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Returning 404 to user: Instance 4c88e17a-19b8-4f75-bbe7-01c014030a3a could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:14.000611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4c41c914-ad4c-41f0-833a-0ad305646b56 tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a" status: 404 len: 111 microversion: 2.1 time: 0.047903 Jul 25 06:06:14.000611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 516/1026] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:13 2022] GET /compute/v2.1/servers/4c88e17a-19b8-4f75-bbe7-01c014030a3a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:14.010953 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4ed902bd-0cfa-4ba2-a98c-1ec9653be48c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6532204d30>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:14.151760 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4ed902bd-0cfa-4ba2-a98c-1ec9653be48c tempest-TestMinimumBasicScenario-124943261 tempest-TestMinimumBasicScenario-124943261-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-687808174" status: 202 len: 0 microversion: 2.1 time: 0.139781 Jul 25 06:06:14.151760 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 517/1027] 10.222.0.40 () {58 vars in 1268 bytes} [Mon Jul 25 06:06:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-687808174 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 06:06:14.151991 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-dacec752-fe76-4965-abb0-c3da9b9d8278 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:14.164757 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-dacec752-fe76-4965-abb0-c3da9b9d8278 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:14.170413 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-dacec752-fe76-4965-abb0-c3da9b9d8278 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:14.172815 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-dacec752-fe76-4965-abb0-c3da9b9d8278 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.322201 Jul 25 06:06:14.173854 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 511/1028] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:13 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:06:14.923560 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e71d9835-c712-4888-a3f1-a32168c4a993 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:14.924327 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e71d9835-c712-4888-a3f1-a32168c4a993 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:14.926461 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:14.932824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e71d9835-c712-4888-a3f1-a32168c4a993 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:14.933278 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e71d9835-c712-4888-a3f1-a32168c4a993 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:14.934050 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e71d9835-c712-4888-a3f1-a32168c4a993 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:14.934505 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e71d9835-c712-4888-a3f1-a32168c4a993 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:14.967503 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e71d9835-c712-4888-a3f1-a32168c4a993 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:14.968206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e71d9835-c712-4888-a3f1-a32168c4a993 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:14.968667 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-e71d9835-c712-4888-a3f1-a32168c4a993 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lazy-loading 'fault' on Instance uuid bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:15.019726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-e71d9835-c712-4888-a3f1-a32168c4a993 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7224418acee432182bf3195bfc8fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea60662f93343019fe380b6e13d5d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:15.028542 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e71d9835-c712-4888-a3f1-a32168c4a993 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 200 len: 1328 microversion: 2.1 time: 0.111216 Jul 25 06:06:15.029588 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 518/1029] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:14 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:15.202883 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8674eda0-8d17-47ec-a7bf-30fbbf15000d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:15.207945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8674eda0-8d17-47ec-a7bf-30fbbf15000d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:15.215890 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8674eda0-8d17-47ec-a7bf-30fbbf15000d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:15.216380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8674eda0-8d17-47ec-a7bf-30fbbf15000d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:15.217184 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8674eda0-8d17-47ec-a7bf-30fbbf15000d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:15.217588 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8674eda0-8d17-47ec-a7bf-30fbbf15000d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:15.313892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-25ffb470-7cfa-4cd6-8b33-88806489fb4c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Action: 'create', calling method: <bound method VolumeAttachmentController.create of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533e9f190>>, body: {"volumeAttachment": {"volumeId": "5cfd73f7-8bdf-44a9-89f6-6b75272c60a6"}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:15.316196 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-25ffb470-7cfa-4cd6-8b33-88806489fb4c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:15.322229 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-25ffb470-7cfa-4cd6-8b33-88806489fb4c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:15.322511 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-25ffb470-7cfa-4cd6-8b33-88806489fb4c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:15.323671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-25ffb470-7cfa-4cd6-8b33-88806489fb4c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:15.324620 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-25ffb470-7cfa-4cd6-8b33-88806489fb4c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:15.415329 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8674eda0-8d17-47ec-a7bf-30fbbf15000d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:15.424361 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8674eda0-8d17-47ec-a7bf-30fbbf15000d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:15.425903 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8674eda0-8d17-47ec-a7bf-30fbbf15000d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:15.427275 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8674eda0-8d17-47ec-a7bf-30fbbf15000d tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.237667 Jul 25 06:06:15.428322 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 512/1030] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:15 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:16.049137 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-bdd08ec9-0343-446a-88dc-5344646f1940 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:16.049778 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-bdd08ec9-0343-446a-88dc-5344646f1940 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:16.057153 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bdd08ec9-0343-446a-88dc-5344646f1940 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:16.057840 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bdd08ec9-0343-446a-88dc-5344646f1940 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:16.059460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bdd08ec9-0343-446a-88dc-5344646f1940 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:16.060087 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bdd08ec9-0343-446a-88dc-5344646f1940 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:16.077262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-bdd08ec9-0343-446a-88dc-5344646f1940 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] HTTP exception thrown: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-bdd08ec9-0343-446a-88dc-5344646f1940 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Request method failure captured: Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b HTTP/1.1 Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFFALlSjL-DgY5moCP7nmzz8131ed284hmG-PhVhDrwSHOswsRSoAQ8xXOVKdEeyvoJVsaYFzqoBCtDHumnfGUSB_RDXQDDrCzgWhrHSDzW_WFNdG3OiaTphFoyolEhOtNL3g628FVyFxYe0Hw2JJm0Xkmw24aaepW707BgON7P9Ew Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:06:16.079684 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ea60662f93343019fe380b6e13d5d18", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: a7224418acee432182bf3195bfc8fd99 Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:16.081670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b'} Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:16.082608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:16.084352 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:16.085618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-bdd08ec9-0343-446a-88dc-5344646f1940 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Returning 404 to user: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:16.085618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-bdd08ec9-0343-446a-88dc-5344646f1940 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 404 len: 111 microversion: 2.1 time: 0.037396 Jul 25 06:06:16.085618 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 513/1031] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:16 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:06:16.091467 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a2a14439-5d54-48a3-a391-09d38318e8a2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f653278e5e0>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:16.257044 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-25ffb470-7cfa-4cd6-8b33-88806489fb4c tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "POST /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.950302 Jul 25 06:06:16.257825 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 519/1032] 10.222.0.40 () {60 vars in 1322 bytes} [Mon Jul 25 06:06:15 2022] POST /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/os-volume_attachments => generated 194 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:16.271110 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a2a14439-5d54-48a3-a391-09d38318e8a2 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804090546" status: 202 len: 0 microversion: 2.1 time: 0.182889 Jul 25 06:06:16.276346 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 514/1033] 10.222.0.40 () {58 vars in 1220 bytes} [Mon Jul 25 06:06:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804090546 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 06:06:16.449156 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2da30343-5370-4a69-8cea-5011e999c5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:16.450288 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2da30343-5370-4a69-8cea-5011e999c5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:16.458131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2da30343-5370-4a69-8cea-5011e999c5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:16.459085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2da30343-5370-4a69-8cea-5011e999c5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:16.460457 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2da30343-5370-4a69-8cea-5011e999c5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:16.461652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-2da30343-5370-4a69-8cea-5011e999c5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:16.739662 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2da30343-5370-4a69-8cea-5011e999c5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:16.755576 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2da30343-5370-4a69-8cea-5011e999c5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:16.755576 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2da30343-5370-4a69-8cea-5011e999c5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:16.756133 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2da30343-5370-4a69-8cea-5011e999c5ef tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.313622 Jul 25 06:06:16.768356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 520/1034] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:16 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:17.371373 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-b99a43f7-279a-4e9d-85ce-c3d2efadb8a2 req-f167a59e-bf5e-423b-b3f4-94bea81e1d3c service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "5e834f53-fb25-48ed-a03c-33717c1e39ff", "name": "network-vif-plugged", "status": "completed", "tag": "ca3ad013-ac59-49fd-a355-d63dbc1c3385"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:17.386759 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-b99a43f7-279a-4e9d-85ce-c3d2efadb8a2 req-f167a59e-bf5e-423b-b3f4-94bea81e1d3c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:17.387216 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-b99a43f7-279a-4e9d-85ce-c3d2efadb8a2 req-f167a59e-bf5e-423b-b3f4-94bea81e1d3c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:17.413363 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-b99a43f7-279a-4e9d-85ce-c3d2efadb8a2 req-f167a59e-bf5e-423b-b3f4-94bea81e1d3c service nova] Creating event network-vif-plugged:ca3ad013-ac59-49fd-a355-d63dbc1c3385 for instance 5e834f53-fb25-48ed-a03c-33717c1e39ff on hv-cinder-84841 Jul 25 06:06:17.415661 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-b99a43f7-279a-4e9d-85ce-c3d2efadb8a2 req-f167a59e-bf5e-423b-b3f4-94bea81e1d3c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049178 Jul 25 06:06:17.416478 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 515/1035] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:17.778442 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3506e0d3-7780-478a-a099-4c494760526b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:17.779973 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3506e0d3-7780-478a-a099-4c494760526b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:17.788287 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3506e0d3-7780-478a-a099-4c494760526b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:17.788738 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3506e0d3-7780-478a-a099-4c494760526b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:17.800648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3506e0d3-7780-478a-a099-4c494760526b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:17.800648 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3506e0d3-7780-478a-a099-4c494760526b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:18.034247 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3506e0d3-7780-478a-a099-4c494760526b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:18.044529 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3506e0d3-7780-478a-a099-4c494760526b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:18.046027 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3506e0d3-7780-478a-a099-4c494760526b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:18.047188 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3506e0d3-7780-478a-a099-4c494760526b tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.275865 Jul 25 06:06:18.047785 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 521/1036] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:17 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:19.066145 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-60190969-2862-42c5-b84c-493f2937a5b4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:19.066865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-60190969-2862-42c5-b84c-493f2937a5b4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:19.078638 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60190969-2862-42c5-b84c-493f2937a5b4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:19.079093 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60190969-2862-42c5-b84c-493f2937a5b4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:19.082094 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60190969-2862-42c5-b84c-493f2937a5b4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:19.082545 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-60190969-2862-42c5-b84c-493f2937a5b4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:19.254861 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-60190969-2862-42c5-b84c-493f2937a5b4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:19.264779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-60190969-2862-42c5-b84c-493f2937a5b4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:19.266787 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-60190969-2862-42c5-b84c-493f2937a5b4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:19.268181 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-60190969-2862-42c5-b84c-493f2937a5b4 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.206297 Jul 25 06:06:19.276519 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 516/1037] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:19 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:19.874726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fc2d8003-496c-4870-86ac-99d3e6294dbc tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:19.876865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-fc2d8003-496c-4870-86ac-99d3e6294dbc tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:19.881762 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fc2d8003-496c-4870-86ac-99d3e6294dbc tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:19.882389 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fc2d8003-496c-4870-86ac-99d3e6294dbc tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:19.884170 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fc2d8003-496c-4870-86ac-99d3e6294dbc tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:19.884602 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fc2d8003-496c-4870-86ac-99d3e6294dbc tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:19.898192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-fc2d8003-496c-4870-86ac-99d3e6294dbc tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] HTTP exception thrown: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fc2d8003-496c-4870-86ac-99d3e6294dbc tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Request method failure captured: Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: DELETE /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b HTTP/1.1 Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFFALlSjL-DgY5moCP7nmzz8131ed284hmG-PhVhDrwSHOswsRSoAQ8xXOVKdEeyvoJVsaYFzqoBCtDHumnfGUSB_RDXQDDrCzgWhrHSDzW_WFNdG3OiaTphFoyolEhOtNL3g628FVyFxYe0Hw2JJm0Xkmw24aaepW707BgON7P9Ew Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:06:19.900696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ea60662f93343019fe380b6e13d5d18", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: a7224418acee432182bf3195bfc8fd99 Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>> Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:19.902407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b'} Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:19.903192 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:19.904730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:19.908320 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fc2d8003-496c-4870-86ac-99d3e6294dbc tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Returning 404 to user: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:19.908320 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-fc2d8003-496c-4870-86ac-99d3e6294dbc tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 404 len: 111 microversion: 2.1 time: 0.031244 Jul 25 06:06:19.908320 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 522/1038] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:06:19 2022] DELETE /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:19.913955 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3fa292e0-5652-497e-872a-00c65a926e8c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:19.915048 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3fa292e0-5652-497e-872a-00c65a926e8c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:19.922021 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3fa292e0-5652-497e-872a-00c65a926e8c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:19.922861 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3fa292e0-5652-497e-872a-00c65a926e8c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:19.924381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3fa292e0-5652-497e-872a-00c65a926e8c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:19.925009 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3fa292e0-5652-497e-872a-00c65a926e8c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:19.942127 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-3fa292e0-5652-497e-872a-00c65a926e8c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] HTTP exception thrown: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3fa292e0-5652-497e-872a-00c65a926e8c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Request method failure captured: Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b HTTP/1.1 Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFFALlSjL-DgY5moCP7nmzz8131ed284hmG-PhVhDrwSHOswsRSoAQ8xXOVKdEeyvoJVsaYFzqoBCtDHumnfGUSB_RDXQDDrCzgWhrHSDzW_WFNdG3OiaTphFoyolEhOtNL3g628FVyFxYe0Hw2JJm0Xkmw24aaepW707BgON7P9Ew Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:06:19.943782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ea60662f93343019fe380b6e13d5d18", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: a7224418acee432182bf3195bfc8fd99 Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:19.945995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b'} Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:19.946726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. Jul 25 06:06:19.947938 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:19.951817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3fa292e0-5652-497e-872a-00c65a926e8c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Returning 404 to user: Instance bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:19.951817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3fa292e0-5652-497e-872a-00c65a926e8c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b" status: 404 len: 111 microversion: 2.1 time: 0.038424 Jul 25 06:06:19.951817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 517/1039] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:19 2022] GET /compute/v2.1/servers/bdbe1008-0db3-40a8-aa3e-bbb6467dcd7b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:06:20.287069 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1631bbf7-ef92-4811-bc71-dd605fd1fd16 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:20.287686 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1631bbf7-ef92-4811-bc71-dd605fd1fd16 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:20.294476 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1631bbf7-ef92-4811-bc71-dd605fd1fd16 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:20.294929 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1631bbf7-ef92-4811-bc71-dd605fd1fd16 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:20.295702 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1631bbf7-ef92-4811-bc71-dd605fd1fd16 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:20.296162 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1631bbf7-ef92-4811-bc71-dd605fd1fd16 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:20.436618 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1631bbf7-ef92-4811-bc71-dd605fd1fd16 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:20.438935 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:20.451263 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1631bbf7-ef92-4811-bc71-dd605fd1fd16 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:20.452828 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1631bbf7-ef92-4811-bc71-dd605fd1fd16 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:20.454258 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1631bbf7-ef92-4811-bc71-dd605fd1fd16 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1729 microversion: 2.20 time: 0.171362 Jul 25 06:06:20.454812 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 523/1040] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:20 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:21.258235 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-47e4ec4d-1c19-41ec-b7d2-a7823af723c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:21.258942 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-47e4ec4d-1c19-41ec-b7d2-a7823af723c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:21.267800 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-47e4ec4d-1c19-41ec-b7d2-a7823af723c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:21.268381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-47e4ec4d-1c19-41ec-b7d2-a7823af723c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:21.269296 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-47e4ec4d-1c19-41ec-b7d2-a7823af723c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:21.269884 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-47e4ec4d-1c19-41ec-b7d2-a7823af723c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:21.287080 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-47e4ec4d-1c19-41ec-b7d2-a7823af723c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] HTTP exception thrown: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-47e4ec4d-1c19-41ec-b7d2-a7823af723c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Request method failure captured: Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: DELETE /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 HTTP/1.1 Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFFALlSjL-DgY5moCP7nmzz8131ed284hmG-PhVhDrwSHOswsRSoAQ8xXOVKdEeyvoJVsaYFzqoBCtDHumnfGUSB_RDXQDDrCzgWhrHSDzW_WFNdG3OiaTphFoyolEhOtNL3g628FVyFxYe0Hw2JJm0Xkmw24aaepW707BgON7P9Ew Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:06:21.290077 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ea60662f93343019fe380b6e13d5d18", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: a7224418acee432182bf3195bfc8fd99 Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>> Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:06:21.291495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'a502c8d3-07ac-4e7f-9127-1281c94c5724'} Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:21.292381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:06:21.294156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:21.295764 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-47e4ec4d-1c19-41ec-b7d2-a7823af723c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Returning 404 to user: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:21.295764 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-47e4ec4d-1c19-41ec-b7d2-a7823af723c3 tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 404 len: 111 microversion: 2.1 time: 0.039121 Jul 25 06:06:21.295764 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 518/1041] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:06:21 2022] DELETE /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:21.301858 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e466561a-13be-4887-b352-e29f329e343c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:21.302543 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e466561a-13be-4887-b352-e29f329e343c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] [instance: a502c8d3-07ac-4e7f-9127-1281c94c5724] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:21.310187 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e466561a-13be-4887-b352-e29f329e343c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:21.310605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e466561a-13be-4887-b352-e29f329e343c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:21.311414 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e466561a-13be-4887-b352-e29f329e343c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:21.311874 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e466561a-13be-4887-b352-e29f329e343c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:21.326612 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-e466561a-13be-4887-b352-e29f329e343c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] HTTP exception thrown: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e466561a-13be-4887-b352-e29f329e343c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Request method failure captured: Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 HTTP/1.1 Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFFALlSjL-DgY5moCP7nmzz8131ed284hmG-PhVhDrwSHOswsRSoAQ8xXOVKdEeyvoJVsaYFzqoBCtDHumnfGUSB_RDXQDDrCzgWhrHSDzW_WFNdG3OiaTphFoyolEhOtNL3g628FVyFxYe0Hw2JJm0Xkmw24aaepW707BgON7P9Ew Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:06:21.328169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_5ea60662f93343019fe380b6e13d5d18", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/5ea60662f93343019fe380b6e13d5d18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: 5ea60662f93343019fe380b6e13d5d18 Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeTestJSON-400151501 Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: a7224418acee432182bf3195bfc8fd99 Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeTestJSON-400151501-project Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:06:21.347102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'a502c8d3-07ac-4e7f-9127-1281c94c5724'} Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:21.348255 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. Jul 25 06:06:21.349753 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:21.351220 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e466561a-13be-4887-b352-e29f329e343c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] Returning 404 to user: Instance a502c8d3-07ac-4e7f-9127-1281c94c5724 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:21.351220 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e466561a-13be-4887-b352-e29f329e343c tempest-AttachVolumeTestJSON-400151501 tempest-AttachVolumeTestJSON-400151501-project] 10.222.0.40 "GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724" status: 404 len: 111 microversion: 2.1 time: 0.031753 Jul 25 06:06:21.351220 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 524/1042] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:21 2022] GET /compute/v2.1/servers/a502c8d3-07ac-4e7f-9127-1281c94c5724 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:21.473734 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ec435dac-83c8-4cb3-9395-383e2e557820 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:21.474440 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ec435dac-83c8-4cb3-9395-383e2e557820 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:21.482919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec435dac-83c8-4cb3-9395-383e2e557820 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:21.483549 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec435dac-83c8-4cb3-9395-383e2e557820 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:21.484673 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec435dac-83c8-4cb3-9395-383e2e557820 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:21.485270 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec435dac-83c8-4cb3-9395-383e2e557820 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:21.724081 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ec435dac-83c8-4cb3-9395-383e2e557820 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:21.733221 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ec435dac-83c8-4cb3-9395-383e2e557820 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:21.734768 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ec435dac-83c8-4cb3-9395-383e2e557820 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:21.736278 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ec435dac-83c8-4cb3-9395-383e2e557820 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1716 microversion: 2.20 time: 0.266668 Jul 25 06:06:21.736834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 519/1043] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:21 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1716 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:24.088353 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a0b7e305-c1ae-4425-b862-4320cb0d9d45 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.delete of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533eb4850>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:24.089734 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a0b7e305-c1ae-4425-b862-4320cb0d9d45 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:24.098876 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a0b7e305-c1ae-4425-b862-4320cb0d9d45 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:24.099577 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a0b7e305-c1ae-4425-b862-4320cb0d9d45 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:24.100556 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a0b7e305-c1ae-4425-b862-4320cb0d9d45 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:24.101154 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a0b7e305-c1ae-4425-b862-4320cb0d9d45 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:24.220219 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-a0b7e305-c1ae-4425-b862-4320cb0d9d45 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lazy-loading 'services' on Instance uuid d21512fe-e078-4674-bb50-659aeebf1a6b {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:24.487447 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a0b7e305-c1ae-4425-b862-4320cb0d9d45 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/os-volume_attachments/5cfd73f7-8bdf-44a9-89f6-6b75272c60a6" status: 202 len: 0 microversion: 2.1 time: 0.403817 Jul 25 06:06:24.488664 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 525/1044] 10.222.0.40 () {58 vars in 1415 bytes} [Mon Jul 25 06:06:24 2022] DELETE /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/os-volume_attachments/5cfd73f7-8bdf-44a9-89f6-6b75272c60a6 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:06:24.498364 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-03f4efd0-c06b-45e1-bdd0-a08d762001d1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:24.500048 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-03f4efd0-c06b-45e1-bdd0-a08d762001d1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:24.510173 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:24.512499 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-03f4efd0-c06b-45e1-bdd0-a08d762001d1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:24.513179 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-03f4efd0-c06b-45e1-bdd0-a08d762001d1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:24.514320 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-03f4efd0-c06b-45e1-bdd0-a08d762001d1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:24.514930 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-03f4efd0-c06b-45e1-bdd0-a08d762001d1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:24.548041 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-03f4efd0-c06b-45e1-bdd0-a08d762001d1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054765 Jul 25 06:06:24.549038 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 520/1045] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:06:24 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:25.560897 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ac69e85f-2541-423a-83ed-94b4ca1a9473 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5df0>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:25.562071 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ac69e85f-2541-423a-83ed-94b4ca1a9473 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:25.569761 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ac69e85f-2541-423a-83ed-94b4ca1a9473 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:25.571028 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ac69e85f-2541-423a-83ed-94b4ca1a9473 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:25.571819 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ac69e85f-2541-423a-83ed-94b4ca1a9473 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:25.572928 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ac69e85f-2541-423a-83ed-94b4ca1a9473 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:25.606554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ac69e85f-2541-423a-83ed-94b4ca1a9473 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051245 Jul 25 06:06:25.607424 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 526/1046] 10.222.0.40 () {58 vars in 1301 bytes} [Mon Jul 25 06:06:25 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 06:06:25.708694 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6988c6d4-0bbb-4299-8415-62d2812cd3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:25.709894 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6988c6d4-0bbb-4299-8415-62d2812cd3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:25.721086 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6988c6d4-0bbb-4299-8415-62d2812cd3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:25.721899 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6988c6d4-0bbb-4299-8415-62d2812cd3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:25.723085 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6988c6d4-0bbb-4299-8415-62d2812cd3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:25.723804 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6988c6d4-0bbb-4299-8415-62d2812cd3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:25.780047 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6988c6d4-0bbb-4299-8415-62d2812cd3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Going to try to terminate instance {{(pid=124917) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:06:26.136663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6988c6d4-0bbb-4299-8415-62d2812cd3a1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 204 len: 0 microversion: 2.1 time: 0.432353 Jul 25 06:06:26.137324 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 521/1047] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:06:25 2022] DELETE /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:06:26.146088 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-680a7331-f79d-49b3-9277-57a1ca830fd6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:26.146824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-680a7331-f79d-49b3-9277-57a1ca830fd6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:26.157578 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-680a7331-f79d-49b3-9277-57a1ca830fd6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:26.158034 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-680a7331-f79d-49b3-9277-57a1ca830fd6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:26.158813 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-680a7331-f79d-49b3-9277-57a1ca830fd6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:26.159254 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-680a7331-f79d-49b3-9277-57a1ca830fd6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:26.302036 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-680a7331-f79d-49b3-9277-57a1ca830fd6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:26.310276 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-680a7331-f79d-49b3-9277-57a1ca830fd6 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1682 microversion: 2.1 time: 0.168523 Jul 25 06:06:26.310839 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 527/1048] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:26 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:06:27.328798 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-eafb5a1e-313c-4a43-a2aa-f2f770ffa15e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:27.329502 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-eafb5a1e-313c-4a43-a2aa-f2f770ffa15e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:27.335832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eafb5a1e-313c-4a43-a2aa-f2f770ffa15e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:27.337002 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eafb5a1e-313c-4a43-a2aa-f2f770ffa15e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:27.337800 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eafb5a1e-313c-4a43-a2aa-f2f770ffa15e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:27.338258 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-eafb5a1e-313c-4a43-a2aa-f2f770ffa15e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:27.484569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-eafb5a1e-313c-4a43-a2aa-f2f770ffa15e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:27.493381 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-eafb5a1e-313c-4a43-a2aa-f2f770ffa15e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1682 microversion: 2.1 time: 0.168894 Jul 25 06:06:27.493958 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 522/1049] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:27 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:28.511171 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c7c87e94-0e76-4e36-9466-d636c02fa59e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:28.511793 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c7c87e94-0e76-4e36-9466-d636c02fa59e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:28.518777 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c7c87e94-0e76-4e36-9466-d636c02fa59e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:28.519249 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c7c87e94-0e76-4e36-9466-d636c02fa59e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:28.520232 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c7c87e94-0e76-4e36-9466-d636c02fa59e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:28.520673 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c7c87e94-0e76-4e36-9466-d636c02fa59e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:28.675569 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c7c87e94-0e76-4e36-9466-d636c02fa59e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:28.684124 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c7c87e94-0e76-4e36-9466-d636c02fa59e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1682 microversion: 2.1 time: 0.177125 Jul 25 06:06:28.687155 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 528/1050] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:28 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:29.104383 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-232b4c49-7110-4acc-a582-5d3096ee70d0 req-baff0e66-f602-4e63-97a8-97b9b28ab216 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "d21512fe-e078-4674-bb50-659aeebf1a6b", "name": "network-vif-deleted", "tag": "7da6481b-18b6-48f5-aaff-0f86837cc82a"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:29.124341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-232b4c49-7110-4acc-a582-5d3096ee70d0 req-baff0e66-f602-4e63-97a8-97b9b28ab216 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:29.124341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-232b4c49-7110-4acc-a582-5d3096ee70d0 req-baff0e66-f602-4e63-97a8-97b9b28ab216 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:29.143866 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-232b4c49-7110-4acc-a582-5d3096ee70d0 req-baff0e66-f602-4e63-97a8-97b9b28ab216 service nova] Creating event network-vif-deleted:7da6481b-18b6-48f5-aaff-0f86837cc82a for instance d21512fe-e078-4674-bb50-659aeebf1a6b on hv-cinder-84841 Jul 25 06:06:29.151520 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-232b4c49-7110-4acc-a582-5d3096ee70d0 req-baff0e66-f602-4e63-97a8-97b9b28ab216 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051653 Jul 25 06:06:29.152545 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 523/1051] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:06:29.702936 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-db947d41-0c67-421c-8459-39830cdec3f0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:29.703568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-db947d41-0c67-421c-8459-39830cdec3f0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:29.710265 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db947d41-0c67-421c-8459-39830cdec3f0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:29.710789 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db947d41-0c67-421c-8459-39830cdec3f0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:29.711924 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db947d41-0c67-421c-8459-39830cdec3f0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:29.712403 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db947d41-0c67-421c-8459-39830cdec3f0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:29.745817 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db947d41-0c67-421c-8459-39830cdec3f0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:29.746279 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-db947d41-0c67-421c-8459-39830cdec3f0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:29.746734 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-db947d41-0c67-421c-8459-39830cdec3f0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lazy-loading 'fault' on Instance uuid d21512fe-e078-4674-bb50-659aeebf1a6b {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:29.791522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-db947d41-0c67-421c-8459-39830cdec3f0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eedefd8d94047478663ceab8962d738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fd13a3dd1d4e2b83cf6e44160adf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:29.799650 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-db947d41-0c67-421c-8459-39830cdec3f0 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 200 len: 1332 microversion: 2.1 time: 0.100467 Jul 25 06:06:29.801182 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 529/1052] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:29 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:30.818745 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4cbb75d8-9457-438c-af7a-653124ed122a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:30.819459 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4cbb75d8-9457-438c-af7a-653124ed122a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:30.826342 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4cbb75d8-9457-438c-af7a-653124ed122a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:30.826784 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4cbb75d8-9457-438c-af7a-653124ed122a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:30.827538 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4cbb75d8-9457-438c-af7a-653124ed122a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:30.827966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4cbb75d8-9457-438c-af7a-653124ed122a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:30.841066 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-4cbb75d8-9457-438c-af7a-653124ed122a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4cbb75d8-9457-438c-af7a-653124ed122a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b HTTP/1.1 Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:06:30.842675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:30.844424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'd21512fe-e078-4674-bb50-659aeebf1a6b'} Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:30.845479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:30.846949 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:30.848423 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4cbb75d8-9457-438c-af7a-653124ed122a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:30.848423 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4cbb75d8-9457-438c-af7a-653124ed122a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 404 len: 111 microversion: 2.1 time: 0.029601 Jul 25 06:06:30.848423 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 524/1053] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:30 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:30.853478 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7b0f6d0c-2780-4a34-95dc-67caa707f2f1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531d2a670>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:30.933747 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7b0f6d0c-2780-4a34-95dc-67caa707f2f1 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129060592" status: 202 len: 0 microversion: 2.1 time: 0.084486 Jul 25 06:06:30.934243 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 530/1054] 10.222.0.40 () {58 vars in 1220 bytes} [Mon Jul 25 06:06:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129060592 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 06:06:32.938131 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2070f713-2be0-4944-ab55-28e3de319f95 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:32.938646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2070f713-2be0-4944-ab55-28e3de319f95 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:32.945531 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2070f713-2be0-4944-ab55-28e3de319f95 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:32.945993 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2070f713-2be0-4944-ab55-28e3de319f95 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:32.946880 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2070f713-2be0-4944-ab55-28e3de319f95 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:32.947313 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2070f713-2be0-4944-ab55-28e3de319f95 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:32.963726 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-2070f713-2be0-4944-ab55-28e3de319f95 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2070f713-2be0-4944-ab55-28e3de319f95 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: DELETE /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b HTTP/1.1 Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:06:32.965272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>> Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:32.966830 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'd21512fe-e078-4674-bb50-659aeebf1a6b'} Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:32.967812 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:32.969663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:32.971788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2070f713-2be0-4944-ab55-28e3de319f95 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:32.971788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2070f713-2be0-4944-ab55-28e3de319f95 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 404 len: 111 microversion: 2.1 time: 0.032579 Jul 25 06:06:32.971788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 525/1055] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:06:32 2022] DELETE /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:32.976056 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-56a2379a-5b7f-47fe-96e1-ec6167255c16 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:32.977312 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-56a2379a-5b7f-47fe-96e1-ec6167255c16 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: d21512fe-e078-4674-bb50-659aeebf1a6b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:32.984039 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-56a2379a-5b7f-47fe-96e1-ec6167255c16 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:32.984518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-56a2379a-5b7f-47fe-96e1-ec6167255c16 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:32.985279 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-56a2379a-5b7f-47fe-96e1-ec6167255c16 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:32.985762 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-56a2379a-5b7f-47fe-96e1-ec6167255c16 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:32.999422 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-56a2379a-5b7f-47fe-96e1-ec6167255c16 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-56a2379a-5b7f-47fe-96e1-ec6167255c16 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b HTTP/1.1 Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:06:33.000872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:33.003949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'd21512fe-e078-4674-bb50-659aeebf1a6b'} Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:33.005092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. Jul 25 06:06:33.006898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:33.008635 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-56a2379a-5b7f-47fe-96e1-ec6167255c16 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance d21512fe-e078-4674-bb50-659aeebf1a6b could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:33.008635 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-56a2379a-5b7f-47fe-96e1-ec6167255c16 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b" status: 404 len: 111 microversion: 2.1 time: 0.030581 Jul 25 06:06:33.008635 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 531/1056] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:32 2022] GET /compute/v2.1/servers/d21512fe-e078-4674-bb50-659aeebf1a6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 06:06:34.277342 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-000128e7-0d70-41aa-881b-3bc2bdac38cb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:34.277929 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-000128e7-0d70-41aa-881b-3bc2bdac38cb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:34.285258 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-000128e7-0d70-41aa-881b-3bc2bdac38cb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:34.288351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-000128e7-0d70-41aa-881b-3bc2bdac38cb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:34.289171 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-000128e7-0d70-41aa-881b-3bc2bdac38cb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:34.289622 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-000128e7-0d70-41aa-881b-3bc2bdac38cb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:34.303506 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-000128e7-0d70-41aa-881b-3bc2bdac38cb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-000128e7-0d70-41aa-881b-3bc2bdac38cb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: DELETE /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 HTTP/1.1 Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:06:34.305920 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>> Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:06:34.307424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': '8fd12755-30ea-4aa4-94ce-e18ed9c29559'} Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:34.308193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:06:34.309403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.310617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-000128e7-0d70-41aa-881b-3bc2bdac38cb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:34.310617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-000128e7-0d70-41aa-881b-3bc2bdac38cb tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 404 len: 111 microversion: 2.1 time: 0.034329 Jul 25 06:06:34.310617 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 526/1057] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:06:34 2022] DELETE /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:34.315992 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-32127cdd-ecf9-4ec2-aad6-e47871522f91 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:34.316656 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-32127cdd-ecf9-4ec2-aad6-e47871522f91 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: 8fd12755-30ea-4aa4-94ce-e18ed9c29559] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:34.326379 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32127cdd-ecf9-4ec2-aad6-e47871522f91 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:34.326876 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32127cdd-ecf9-4ec2-aad6-e47871522f91 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:34.327605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32127cdd-ecf9-4ec2-aad6-e47871522f91 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:34.328035 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-32127cdd-ecf9-4ec2-aad6-e47871522f91 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:34.342071 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-32127cdd-ecf9-4ec2-aad6-e47871522f91 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-32127cdd-ecf9-4ec2-aad6-e47871522f91 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 HTTP/1.1 Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:06:34.343652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:06:34.345325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': '8fd12755-30ea-4aa4-94ce-e18ed9c29559'} Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:34.346419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. Jul 25 06:06:34.347880 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.349407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-32127cdd-ecf9-4ec2-aad6-e47871522f91 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance 8fd12755-30ea-4aa4-94ce-e18ed9c29559 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:34.349407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-32127cdd-ecf9-4ec2-aad6-e47871522f91 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559" status: 404 len: 111 microversion: 2.1 time: 0.033026 Jul 25 06:06:34.349407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 532/1058] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:34 2022] GET /compute/v2.1/servers/8fd12755-30ea-4aa4-94ce-e18ed9c29559 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:34.354319 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4d94581f-e704-4948-a163-53b836bd085a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:34.354827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4d94581f-e704-4948-a163-53b836bd085a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:34.362382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4d94581f-e704-4948-a163-53b836bd085a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:34.362930 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4d94581f-e704-4948-a163-53b836bd085a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:34.363715 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4d94581f-e704-4948-a163-53b836bd085a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:34.364181 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4d94581f-e704-4948-a163-53b836bd085a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:34.378316 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-4d94581f-e704-4948-a163-53b836bd085a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4d94581f-e704-4948-a163-53b836bd085a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: DELETE /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 HTTP/1.1 Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:06:34.379878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>> Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:06:34.381330 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'cffe93da-af1c-417f-8b03-0d6262028356'} Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:34.382055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:06:34.383998 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.385522 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4d94581f-e704-4948-a163-53b836bd085a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:34.386202 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4d94581f-e704-4948-a163-53b836bd085a tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 404 len: 111 microversion: 2.1 time: 0.031635 Jul 25 06:06:34.387223 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 527/1059] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:06:34 2022] DELETE /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:34.395256 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a72467c1-a36d-45e5-9513-41df52b9ac1e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:34.395865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a72467c1-a36d-45e5-9513-41df52b9ac1e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: cffe93da-af1c-417f-8b03-0d6262028356] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:34.402670 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a72467c1-a36d-45e5-9513-41df52b9ac1e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:34.403116 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a72467c1-a36d-45e5-9513-41df52b9ac1e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:34.403866 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a72467c1-a36d-45e5-9513-41df52b9ac1e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:34.404337 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-a72467c1-a36d-45e5-9513-41df52b9ac1e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:34.418099 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-a72467c1-a36d-45e5-9513-41df52b9ac1e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a72467c1-a36d-45e5-9513-41df52b9ac1e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 HTTP/1.1 Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:06:34.419605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:06:34.421144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'cffe93da-af1c-417f-8b03-0d6262028356'} Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:34.421892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. Jul 25 06:06:34.423115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:34.424347 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a72467c1-a36d-45e5-9513-41df52b9ac1e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance cffe93da-af1c-417f-8b03-0d6262028356 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:34.424347 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a72467c1-a36d-45e5-9513-41df52b9ac1e tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356" status: 404 len: 111 microversion: 2.1 time: 0.029718 Jul 25 06:06:34.424347 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 533/1060] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:34 2022] GET /compute/v2.1/servers/cffe93da-af1c-417f-8b03-0d6262028356 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:35.730091 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-350fb4ad-2df3-44dc-9130-a5965ad1f1bd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:35.730652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-350fb4ad-2df3-44dc-9130-a5965ad1f1bd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:35.738521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-350fb4ad-2df3-44dc-9130-a5965ad1f1bd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:35.739763 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-350fb4ad-2df3-44dc-9130-a5965ad1f1bd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:35.739975 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-350fb4ad-2df3-44dc-9130-a5965ad1f1bd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:35.740556 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-350fb4ad-2df3-44dc-9130-a5965ad1f1bd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:35.755219 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-350fb4ad-2df3-44dc-9130-a5965ad1f1bd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-350fb4ad-2df3-44dc-9130-a5965ad1f1bd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: DELETE /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 HTTP/1.1 Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:06:35.758529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>> Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:06:35.765643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'efb335ec-f540-494a-a2c7-c8db2f467c02'} Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:35.766655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:06:35.768633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:06:35.770105 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-350fb4ad-2df3-44dc-9130-a5965ad1f1bd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:35.770105 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-350fb4ad-2df3-44dc-9130-a5965ad1f1bd tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "DELETE /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 404 len: 111 microversion: 2.1 time: 0.035081 Jul 25 06:06:35.770105 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 528/1061] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:06:35 2022] DELETE /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:35.774310 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3e1d28e6-d4a8-41ae-aa0d-3271f2acffa4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:35.775040 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3e1d28e6-d4a8-41ae-aa0d-3271f2acffa4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] [instance: efb335ec-f540-494a-a2c7-c8db2f467c02] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:35.783611 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3e1d28e6-d4a8-41ae-aa0d-3271f2acffa4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:35.784066 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3e1d28e6-d4a8-41ae-aa0d-3271f2acffa4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:35.784898 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3e1d28e6-d4a8-41ae-aa0d-3271f2acffa4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:35.785332 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3e1d28e6-d4a8-41ae-aa0d-3271f2acffa4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:35.799521 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-3e1d28e6-d4a8-41ae-aa0d-3271f2acffa4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] HTTP exception thrown: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3e1d28e6-d4a8-41ae-aa0d-3271f2acffa4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Request method failure captured: Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 HTTP/1.1 Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFKRsn_pI6B5-TnBB8dbXGiGFUxUWFQmxJGblDhnpmTMO-OjuzNZxC2xRE8G70YFaG3DNVzGVhNaWdWk99ZV2_1-l7wo4WsOKnUo-WJ-ikkzEu1x3N9bDCCtn-jp_yHfBcEdSTHOBwvoTAEGH27V6Jj1QLCaOzxNxVw8OJtWbN4ufo Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:06:35.801074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a6fd13a3dd1d4e2b83cf6e44160adf35", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a6fd13a3dd1d4e2b83cf6e44160adf35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: a6fd13a3dd1d4e2b83cf6e44160adf35 Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1825369983 Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 8eedefd8d94047478663ceab8962d738 Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeNegativeTest-1825369983-project Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:06:35.802714 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'efb335ec-f540-494a-a2c7-c8db2f467c02'} Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:06:35.803607 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. Jul 25 06:06:35.805595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:06:35.806876 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3e1d28e6-d4a8-41ae-aa0d-3271f2acffa4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] Returning 404 to user: Instance efb335ec-f540-494a-a2c7-c8db2f467c02 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:06:35.806876 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3e1d28e6-d4a8-41ae-aa0d-3271f2acffa4 tempest-AttachVolumeNegativeTest-1825369983 tempest-AttachVolumeNegativeTest-1825369983-project] 10.222.0.40 "GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02" status: 404 len: 111 microversion: 2.1 time: 0.033274 Jul 25 06:06:35.806876 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 534/1062] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:06:35 2022] GET /compute/v2.1/servers/efb335ec-f540-494a-a2c7-c8db2f467c02 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:06:54.696503 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-bd4016e7-e743-48f5-ab58-59518c118ea7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method VolumeAttachmentController.index of <nova.api.openstack.compute.volumes.VolumeAttachmentController object at 0x7f6533ea5e20>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:54.697609 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-bd4016e7-e743-48f5-ab58-59518c118ea7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:54.700470 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:54.701961 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:54.709722 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bd4016e7-e743-48f5-ab58-59518c118ea7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:54.712300 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bd4016e7-e743-48f5-ab58-59518c118ea7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:54.712300 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bd4016e7-e743-48f5-ab58-59518c118ea7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:54.712300 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bd4016e7-e743-48f5-ab58-59518c118ea7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:54.747264 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-bd4016e7-e743-48f5-ab58-59518c118ea7 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054886 Jul 25 06:06:54.748875 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 529/1063] 10.222.0.40 () {60 vars in 1342 bytes} [Mon Jul 25 06:06:54 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:06:54.818445 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f70da67e-d161-4257-ae0e-964622ad53e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:54.819041 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f70da67e-d161-4257-ae0e-964622ad53e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:54.823945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:54.826351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:06:54.866092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f70da67e-d161-4257-ae0e-964622ad53e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:54.866092 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f70da67e-d161-4257-ae0e-964622ad53e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:54.869244 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f70da67e-d161-4257-ae0e-964622ad53e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:54.869921 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f70da67e-d161-4257-ae0e-964622ad53e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:54.924979 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f70da67e-d161-4257-ae0e-964622ad53e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:06:55.287671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f70da67e-d161-4257-ae0e-964622ad53e2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 204 len: 0 microversion: 2.20 time: 0.473328 Jul 25 06:06:55.288393 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 535/1064] 10.222.0.40 () {60 vars in 1279 bytes} [Mon Jul 25 06:06:54 2022] DELETE /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 06:06:55.298408 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-33bc52d8-edfb-486f-8749-ec4dedb2aeb2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:55.299094 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-33bc52d8-edfb-486f-8749-ec4dedb2aeb2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:55.306559 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-33bc52d8-edfb-486f-8749-ec4dedb2aeb2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:55.307082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-33bc52d8-edfb-486f-8749-ec4dedb2aeb2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:55.307916 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-33bc52d8-edfb-486f-8749-ec4dedb2aeb2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:55.308588 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-33bc52d8-edfb-486f-8749-ec4dedb2aeb2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:55.525580 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-33bc52d8-edfb-486f-8749-ec4dedb2aeb2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:55.545257 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-33bc52d8-edfb-486f-8749-ec4dedb2aeb2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:55.547289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-33bc52d8-edfb-486f-8749-ec4dedb2aeb2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:55.548679 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-33bc52d8-edfb-486f-8749-ec4dedb2aeb2 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1722 microversion: 2.20 time: 0.255657 Jul 25 06:06:55.549669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 530/1065] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:55 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 06:06:56.568378 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-64866d58-eb00-4308-b676-66792238f063 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:56.569273 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-64866d58-eb00-4308-b676-66792238f063 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:56.582945 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-64866d58-eb00-4308-b676-66792238f063 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:56.586578 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-64866d58-eb00-4308-b676-66792238f063 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:56.589059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-64866d58-eb00-4308-b676-66792238f063 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:56.589742 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-64866d58-eb00-4308-b676-66792238f063 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:56.858551 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-64866d58-eb00-4308-b676-66792238f063 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:56.868446 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-64866d58-eb00-4308-b676-66792238f063 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:56.870471 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-64866d58-eb00-4308-b676-66792238f063 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:56.871901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-64866d58-eb00-4308-b676-66792238f063 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1722 microversion: 2.20 time: 0.308737 Jul 25 06:06:56.874182 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 536/1066] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:56 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:57.894770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-820c2cd3-eb35-42bf-a4dc-56e47f0b6408 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:57.895415 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-820c2cd3-eb35-42bf-a4dc-56e47f0b6408 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:57.905201 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-820c2cd3-eb35-42bf-a4dc-56e47f0b6408 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:57.905956 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-820c2cd3-eb35-42bf-a4dc-56e47f0b6408 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:57.907008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-820c2cd3-eb35-42bf-a4dc-56e47f0b6408 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:57.907454 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-820c2cd3-eb35-42bf-a4dc-56e47f0b6408 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:58.006202 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-820c2cd3-eb35-42bf-a4dc-56e47f0b6408 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:58.015269 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-820c2cd3-eb35-42bf-a4dc-56e47f0b6408 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:58.017085 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-820c2cd3-eb35-42bf-a4dc-56e47f0b6408 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:58.018529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-820c2cd3-eb35-42bf-a4dc-56e47f0b6408 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1655 microversion: 2.20 time: 0.128408 Jul 25 06:06:58.019572 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 531/1067] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:57 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1655 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:06:58.256946 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-20d9996c-b5eb-4ca2-946a-cbf9e81d4f08 req-3ded9403-ac90-48c8-88ac-ea71a4cfc2d2 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "5e834f53-fb25-48ed-a03c-33717c1e39ff", "name": "network-vif-deleted", "tag": "ca3ad013-ac59-49fd-a355-d63dbc1c3385"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:06:58.274394 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-20d9996c-b5eb-4ca2-946a-cbf9e81d4f08 req-3ded9403-ac90-48c8-88ac-ea71a4cfc2d2 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:58.274840 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-20d9996c-b5eb-4ca2-946a-cbf9e81d4f08 req-3ded9403-ac90-48c8-88ac-ea71a4cfc2d2 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:58.287793 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-20d9996c-b5eb-4ca2-946a-cbf9e81d4f08 req-3ded9403-ac90-48c8-88ac-ea71a4cfc2d2 service nova] Creating event network-vif-deleted:ca3ad013-ac59-49fd-a355-d63dbc1c3385 for instance 5e834f53-fb25-48ed-a03c-33717c1e39ff on hv-cinder-84841 Jul 25 06:06:58.292806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-20d9996c-b5eb-4ca2-946a-cbf9e81d4f08 req-3ded9403-ac90-48c8-88ac-ea71a4cfc2d2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039876 Jul 25 06:06:58.296726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 537/1068] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:06:59.038243 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:06:59.039167 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:06:59.047135 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:59.047677 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:59.048992 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:59.049825 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:59.089796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:06:59.089796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:06:59.089796 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lazy-loading 'fault' on Instance uuid 5e834f53-fb25-48ed-a03c-33717c1e39ff {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:06:59.136552 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:59.147036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:59.150343 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd485f9fc38a442dd9e1528024460fcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1871c9af781743f5af1d92371a42ecf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:06:59.158776 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-294d7eaf-727e-443a-b550-345efe391de5 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 200 len: 1371 microversion: 2.20 time: 0.117843 Jul 25 06:06:59.158776 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 532/1069] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:06:59 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 1371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 06:07:00.173181 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-335f36c6-2268-4916-b91a-c8590bb4463e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:00.174000 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-335f36c6-2268-4916-b91a-c8590bb4463e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:00.180653 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-335f36c6-2268-4916-b91a-c8590bb4463e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:00.181456 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-335f36c6-2268-4916-b91a-c8590bb4463e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:00.182771 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-335f36c6-2268-4916-b91a-c8590bb4463e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:00.183407 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-335f36c6-2268-4916-b91a-c8590bb4463e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:00.202202 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-335f36c6-2268-4916-b91a-c8590bb4463e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] HTTP exception thrown: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-335f36c6-2268-4916-b91a-c8590bb4463e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Request method failure captured: Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff HTTP/1.1 Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFMsd7VnC2kr70aIzPrFdLMYtenFSQtqdHvqO-np3XX20Ut6YTFTsAznFB7C5DysmkzZhBhWb56f_stDheLeg0EaJUm8yyhdkZYgJATZ1W1ZlEx7qSzy1FVmz9YpeWZEzRFCIv0xXCbsoIZVHaRmVSo38CPWkF9zU2yQhev4nDC1Tk Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:07:00.204720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1871c9af781743f5af1d92371a42ecf1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: d485f9fc38a442dd9e1528024460fcca Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:00.212677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': '5e834f53-fb25-48ed-a03c-33717c1e39ff'} Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:07:00.213678 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:00.216174 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:00.218057 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-335f36c6-2268-4916-b91a-c8590bb4463e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Returning 404 to user: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:07:00.218057 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-335f36c6-2268-4916-b91a-c8590bb4463e tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 404 len: 111 microversion: 2.20 time: 0.039690 Jul 25 06:07:00.218057 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 538/1070] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:07:00 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:07:00.221459 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c38e117c-8cbd-4cc4-97fc-f50a6921f279 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531e09ee0>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:00.323359 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c38e117c-8cbd-4cc4-97fc-f50a6921f279 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-882577647" status: 204 len: 0 microversion: 2.20 time: 0.108740 Jul 25 06:07:00.324148 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 533/1071] 10.222.0.40 () {60 vars in 1258 bytes} [Mon Jul 25 06:07:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-882577647 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 06:07:02.711084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-45d764c0-a241-4317-bf3c-4a56068fc7a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:02.712325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-45d764c0-a241-4317-bf3c-4a56068fc7a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:02.728873 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-45d764c0-a241-4317-bf3c-4a56068fc7a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:02.729504 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-45d764c0-a241-4317-bf3c-4a56068fc7a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:02.730468 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-45d764c0-a241-4317-bf3c-4a56068fc7a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:02.730917 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-45d764c0-a241-4317-bf3c-4a56068fc7a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:02.767927 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-45d764c0-a241-4317-bf3c-4a56068fc7a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] HTTP exception thrown: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-45d764c0-a241-4317-bf3c-4a56068fc7a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Request method failure captured: Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: DELETE /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff HTTP/1.1 Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFMsd7VnC2kr70aIzPrFdLMYtenFSQtqdHvqO-np3XX20Ut6YTFTsAznFB7C5DysmkzZhBhWb56f_stDheLeg0EaJUm8yyhdkZYgJATZ1W1ZlEx7qSzy1FVmz9YpeWZEzRFCIv0xXCbsoIZVHaRmVSo38CPWkF9zU2yQhev4nDC1Tk Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:07:02.769518 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1871c9af781743f5af1d92371a42ecf1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: d485f9fc38a442dd9e1528024460fcca Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>> Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:02.771058 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': '5e834f53-fb25-48ed-a03c-33717c1e39ff'} Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:07:02.771861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:02.773201 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:02.774841 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-45d764c0-a241-4317-bf3c-4a56068fc7a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Returning 404 to user: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:07:02.774841 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-45d764c0-a241-4317-bf3c-4a56068fc7a9 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 404 len: 111 microversion: 2.20 time: 0.066958 Jul 25 06:07:02.774841 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 539/1072] 10.222.0.40 () {60 vars in 1279 bytes} [Mon Jul 25 06:07:02 2022] DELETE /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:07:02.787791 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-48efb0f1-685e-4a7a-809c-93665bfd0abf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:02.788574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-48efb0f1-685e-4a7a-809c-93665bfd0abf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: 5e834f53-fb25-48ed-a03c-33717c1e39ff] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:02.812069 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48efb0f1-685e-4a7a-809c-93665bfd0abf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:02.812780 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48efb0f1-685e-4a7a-809c-93665bfd0abf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:02.814329 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48efb0f1-685e-4a7a-809c-93665bfd0abf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:02.815659 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-48efb0f1-685e-4a7a-809c-93665bfd0abf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:02.851125 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-48efb0f1-685e-4a7a-809c-93665bfd0abf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] HTTP exception thrown: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-48efb0f1-685e-4a7a-809c-93665bfd0abf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Request method failure captured: Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff HTTP/1.1 Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFMsd7VnC2kr70aIzPrFdLMYtenFSQtqdHvqO-np3XX20Ut6YTFTsAznFB7C5DysmkzZhBhWb56f_stDheLeg0EaJUm8yyhdkZYgJATZ1W1ZlEx7qSzy1FVmz9YpeWZEzRFCIv0xXCbsoIZVHaRmVSo38CPWkF9zU2yQhev4nDC1Tk Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:07:02.853380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1871c9af781743f5af1d92371a42ecf1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: d485f9fc38a442dd9e1528024460fcca Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:02.854809 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': '5e834f53-fb25-48ed-a03c-33717c1e39ff'} Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:07:02.855652 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. Jul 25 06:07:02.857039 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:07:02.859163 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-48efb0f1-685e-4a7a-809c-93665bfd0abf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Returning 404 to user: Instance 5e834f53-fb25-48ed-a03c-33717c1e39ff could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:07:02.860180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-48efb0f1-685e-4a7a-809c-93665bfd0abf tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff" status: 404 len: 111 microversion: 2.20 time: 0.080806 Jul 25 06:07:02.860868 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 534/1073] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:07:02 2022] GET /compute/v2.1/servers/5e834f53-fb25-48ed-a03c-33717c1e39ff => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:07:04.212157 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3487c054-499e-4e42-8509-affd2fcf7c69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:04.212661 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3487c054-499e-4e42-8509-affd2fcf7c69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:04.219877 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3487c054-499e-4e42-8509-affd2fcf7c69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:04.220790 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3487c054-499e-4e42-8509-affd2fcf7c69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:04.221101 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3487c054-499e-4e42-8509-affd2fcf7c69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:04.225302 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3487c054-499e-4e42-8509-affd2fcf7c69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:04.252313 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-3487c054-499e-4e42-8509-affd2fcf7c69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] HTTP exception thrown: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3487c054-499e-4e42-8509-affd2fcf7c69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Request method failure captured: Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: DELETE /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 HTTP/1.1 Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jFMsd7VnC2kr70aIzPrFdLMYtenFSQtqdHvqO-np3XX20Ut6YTFTsAznFB7C5DysmkzZhBhWb56f_stDheLeg0EaJUm8yyhdkZYgJATZ1W1ZlEx7qSzy1FVmz9YpeWZEzRFCIv0xXCbsoIZVHaRmVSo38CPWkF9zU2yQhev4nDC1Tk Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:07:04.254029 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1871c9af781743f5af1d92371a42ecf1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: d485f9fc38a442dd9e1528024460fcca Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>> Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:07:04.255752 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'b2dc5c54-08fc-4392-a4b9-f1970578ffb7'} Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:07:04.256689 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:07:04.258169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:07:04.259646 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3487c054-499e-4e42-8509-affd2fcf7c69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Returning 404 to user: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:07:04.259646 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3487c054-499e-4e42-8509-affd2fcf7c69 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 404 len: 111 microversion: 2.20 time: 0.048918 Jul 25 06:07:04.259646 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 540/1074] 10.222.0.40 () {60 vars in 1279 bytes} [Mon Jul 25 06:07:04 2022] DELETE /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:07:04.267452 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-994b19da-b9ae-4cd8-99c5-75afac80c781 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:04.268302 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-994b19da-b9ae-4cd8-99c5-75afac80c781 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] [instance: b2dc5c54-08fc-4392-a4b9-f1970578ffb7] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:04.280779 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-994b19da-b9ae-4cd8-99c5-75afac80c781 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:04.281586 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-994b19da-b9ae-4cd8-99c5-75afac80c781 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:04.282599 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-994b19da-b9ae-4cd8-99c5-75afac80c781 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:04.283102 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-994b19da-b9ae-4cd8-99c5-75afac80c781 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:04.301761 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-994b19da-b9ae-4cd8-99c5-75afac80c781 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] HTTP exception thrown: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-994b19da-b9ae-4cd8-99c5-75afac80c781 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Request method failure captured: Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 HTTP/1.1 Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jFMsd7VnC2kr70aIzPrFdLMYtenFSQtqdHvqO-np3XX20Ut6YTFTsAznFB7C5DysmkzZhBhWb56f_stDheLeg0EaJUm8yyhdkZYgJATZ1W1ZlEx7qSzy1FVmz9YpeWZEzRFCIv0xXCbsoIZVHaRmVSo38CPWkF9zU2yQhev4nDC1Tk Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:07:04.303574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1871c9af781743f5af1d92371a42ecf1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1871c9af781743f5af1d92371a42ecf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 1871c9af781743f5af1d92371a42ecf1 Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-74229916 Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: d485f9fc38a442dd9e1528024460fcca Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-AttachVolumeShelveTestJSON-74229916-project Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:07:04.305045 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'b2dc5c54-08fc-4392-a4b9-f1970578ffb7'} Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:07:04.305834 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. Jul 25 06:07:04.308925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:07:04.310350 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-994b19da-b9ae-4cd8-99c5-75afac80c781 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] Returning 404 to user: Instance b2dc5c54-08fc-4392-a4b9-f1970578ffb7 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:07:04.310350 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-994b19da-b9ae-4cd8-99c5-75afac80c781 tempest-AttachVolumeShelveTestJSON-74229916 tempest-AttachVolumeShelveTestJSON-74229916-project] 10.222.0.40 "GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7" status: 404 len: 111 microversion: 2.20 time: 0.042080 Jul 25 06:07:04.310350 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 535/1075] 10.222.0.40 () {60 vars in 1276 bytes} [Mon Jul 25 06:07:04 2022] GET /compute/v2.1/servers/b2dc5c54-08fc-4392-a4b9-f1970578ffb7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 06:07:05.768283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-678939bf-b7f4-4e69-87fc-0e2692596a72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f653210d430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1193999269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVm9+mvFlRH0MnMx6tfZS4D9aazM63t+JL1MXUmV8gNosOPYsmTA2NQPB6eDzjbqaez3NjmFXKwl8AEv3ndViXGtMK1S3+lmkjVuPM444i0RwqFX3s8yxiALr5dBPlVGA=="}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:05.784793 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-678939bf-b7f4-4e69-87fc-0e2692596a72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Getting quotas for project d275686dbcfc44769065d5d9ba1a6f0c. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:07:05.789232 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-678939bf-b7f4-4e69-87fc-0e2692596a72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Getting quotas for user 86335999e9744e4c815a628607618b4f and project d275686dbcfc44769065d5d9ba1a6f0c. Resources: {'key_pairs'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:07:05.924974 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-678939bf-b7f4-4e69-87fc-0e2692596a72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.420929 Jul 25 06:07:05.927102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 541/1076] 10.222.0.40 () {60 vars in 1158 bytes} [Mon Jul 25 06:07:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:31.145379 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:31.146392 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=30 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:31.365121 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-357b3d87-88a5-4c44-bc4b-15db182550ba tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Action: 'create', calling method: <function Controller.__getattribute__.<locals>.version_select at 0x7f6531de80d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1968237889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8bgnisCGAjMg02Mbr8nqZSGOnleTsp0IBMYLawfwTu6yGpfWTNyfAi1i91j9wNfHhOBaUkBJvPI9H29EHFZ/Gm+0ioTJM/vHo9kvgNQBtif4Usk316nZcty+pf/HeUqg=="}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:31.384026 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-357b3d87-88a5-4c44-bc4b-15db182550ba tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Getting quotas for project 3520876da8974c439cef1b35397029f9. Resources: {'key_pairs'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:07:31.388356 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-357b3d87-88a5-4c44-bc4b-15db182550ba tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Getting quotas for user 3eca908cd8a1481c9e4c11036cd4df7b and project 3520876da8974c439cef1b35397029f9. Resources: {'key_pairs'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:07:31.511969 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-357b3d87-88a5-4c44-bc4b-15db182550ba tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.371979 Jul 25 06:07:31.512627 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 536/1077] 10.222.0.40 () {60 vars in 1158 bytes} [Mon Jul 25 06:07:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:34.062781 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:34.063646 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=4 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:34.065904 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:34.071405 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5c4c0>>, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-678653312", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1193999269", "security_groups": [{"name": "tempest-secgroup-smoke-1525845504"}], "block_device_mapping_v2": [{"uuid": "8af6e1c5-7fa8-4250-9c4d-dd016d0d6014", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61120c55-35c0-41eb-8aba-884eee11abab"}]}} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:34.247057 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.network.neutron [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] validate_networks() for [('61120c55-35c0-41eb-8aba-884eee11abab', None, None, None, None, None)] {{(pid=124918) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:07:34.722025 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Flavor limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:07:34.722529 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Image limits 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:07:34.723402 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Flavor pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:07:34.723881 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Image pref 0:0:0 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:07:34.724596 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.virt.hardware [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124918) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:07:34.741930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:34.742400 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:34.743261 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:34.743704 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:34.777962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Getting quotas for project d275686dbcfc44769065d5d9ba1a6f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:07:34.783538 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.quota [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Getting quotas for user 86335999e9744e4c815a628607618b4f and project d275686dbcfc44769065d5d9ba1a6f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=124918) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:07:34.851086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Going to run 1 instances... {{(pid=124918) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:07:34.854550 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='8af6e1c5-7fa8-4250-9c4d-dd016d0d6014',volume_size=None,volume_type=None)] {{(pid=124918) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:07:35.344521 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-83b9f163-978b-4024-8539-b61e3d30a7a7 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.283092 Jul 25 06:07:35.345181 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 542/1078] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:07:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:07:35.355714 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c7fdd4b1-35bd-4a8c-81d0-053de4053422 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:35.356454 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c7fdd4b1-35bd-4a8c-81d0-053de4053422 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:35.413811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c7fdd4b1-35bd-4a8c-81d0-053de4053422 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:35.422031 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c7fdd4b1-35bd-4a8c-81d0-053de4053422 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1094 microversion: 2.1 time: 0.070593 Jul 25 06:07:35.422828 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 537/1079] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:35 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:36.440001 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fc802eaa-82e3-4ec2-a922-fbf9b1daefbc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:36.440631 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-fc802eaa-82e3-4ec2-a922-fbf9b1daefbc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:36.446821 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fc802eaa-82e3-4ec2-a922-fbf9b1daefbc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:36.447273 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fc802eaa-82e3-4ec2-a922-fbf9b1daefbc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:36.448031 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fc802eaa-82e3-4ec2-a922-fbf9b1daefbc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:36.448494 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fc802eaa-82e3-4ec2-a922-fbf9b1daefbc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:36.517736 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-fc802eaa-82e3-4ec2-a922-fbf9b1daefbc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:36.525672 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-fc802eaa-82e3-4ec2-a922-fbf9b1daefbc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1144 microversion: 2.1 time: 0.090603 Jul 25 06:07:36.536585 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 543/1080] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:36 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:37.548975 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d75c0514-5b97-4d58-b0c0-0bb1bc799470 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:37.549607 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d75c0514-5b97-4d58-b0c0-0bb1bc799470 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:37.556223 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d75c0514-5b97-4d58-b0c0-0bb1bc799470 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:37.556672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d75c0514-5b97-4d58-b0c0-0bb1bc799470 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:37.557430 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d75c0514-5b97-4d58-b0c0-0bb1bc799470 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:37.557864 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d75c0514-5b97-4d58-b0c0-0bb1bc799470 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:37.633742 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d75c0514-5b97-4d58-b0c0-0bb1bc799470 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:37.641608 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d75c0514-5b97-4d58-b0c0-0bb1bc799470 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1192 microversion: 2.1 time: 0.097154 Jul 25 06:07:37.642260 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 538/1081] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:37 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:38.665693 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-310ff98b-727d-46da-8c63-54ff704fa62f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:38.666313 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-310ff98b-727d-46da-8c63-54ff704fa62f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:38.673532 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-310ff98b-727d-46da-8c63-54ff704fa62f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:38.675317 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-310ff98b-727d-46da-8c63-54ff704fa62f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:38.676125 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-310ff98b-727d-46da-8c63-54ff704fa62f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:38.676574 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-310ff98b-727d-46da-8c63-54ff704fa62f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:38.744147 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-310ff98b-727d-46da-8c63-54ff704fa62f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:38.755356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-310ff98b-727d-46da-8c63-54ff704fa62f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1210 microversion: 2.1 time: 0.091837 Jul 25 06:07:38.755356 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 544/1082] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:38 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:39.771409 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-12e17d5f-2954-4a30-9ffd-5117f211fdab tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:39.771832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-12e17d5f-2954-4a30-9ffd-5117f211fdab tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:39.778529 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-12e17d5f-2954-4a30-9ffd-5117f211fdab tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:39.779075 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-12e17d5f-2954-4a30-9ffd-5117f211fdab tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:39.779858 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-12e17d5f-2954-4a30-9ffd-5117f211fdab tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:39.780343 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-12e17d5f-2954-4a30-9ffd-5117f211fdab tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:39.845304 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-12e17d5f-2954-4a30-9ffd-5117f211fdab tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:39.852725 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-12e17d5f-2954-4a30-9ffd-5117f211fdab tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1210 microversion: 2.1 time: 0.085726 Jul 25 06:07:39.853285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 539/1083] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:39 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:40.870495 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-94046022-c064-407b-bbcb-e66bb4b1e3aa tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:40.871558 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-94046022-c064-407b-bbcb-e66bb4b1e3aa tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:40.885717 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-94046022-c064-407b-bbcb-e66bb4b1e3aa tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:40.885717 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-94046022-c064-407b-bbcb-e66bb4b1e3aa tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:40.888778 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-94046022-c064-407b-bbcb-e66bb4b1e3aa tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:40.888778 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-94046022-c064-407b-bbcb-e66bb4b1e3aa tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:40.960562 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-94046022-c064-407b-bbcb-e66bb4b1e3aa tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:40.968268 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-94046022-c064-407b-bbcb-e66bb4b1e3aa tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1210 microversion: 2.1 time: 0.101816 Jul 25 06:07:40.968840 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 545/1084] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:40 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:41.986386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-59dd2eba-ed34-45ab-8731-b941b15030a8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:41.987575 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-59dd2eba-ed34-45ab-8731-b941b15030a8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:41.994294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59dd2eba-ed34-45ab-8731-b941b15030a8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:41.994747 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59dd2eba-ed34-45ab-8731-b941b15030a8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:41.995510 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59dd2eba-ed34-45ab-8731-b941b15030a8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:41.995966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-59dd2eba-ed34-45ab-8731-b941b15030a8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:42.138410 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-59dd2eba-ed34-45ab-8731-b941b15030a8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:42.146035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-59dd2eba-ed34-45ab-8731-b941b15030a8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1278 microversion: 2.1 time: 0.164296 Jul 25 06:07:42.146687 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 540/1085] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:41 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:43.164035 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f0a6638a-44d9-4161-b15e-8ad6a51df80e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:43.164682 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f0a6638a-44d9-4161-b15e-8ad6a51df80e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:43.171836 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f0a6638a-44d9-4161-b15e-8ad6a51df80e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:43.176281 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f0a6638a-44d9-4161-b15e-8ad6a51df80e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:43.176281 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f0a6638a-44d9-4161-b15e-8ad6a51df80e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:43.176281 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f0a6638a-44d9-4161-b15e-8ad6a51df80e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:43.304156 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f0a6638a-44d9-4161-b15e-8ad6a51df80e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:43.311639 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f0a6638a-44d9-4161-b15e-8ad6a51df80e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1278 microversion: 2.1 time: 0.151502 Jul 25 06:07:43.312223 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 546/1086] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:43 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:44.205633 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-7fb0743b-a461-4010-a903-789d2194bc3d req-3e94176d-c3ec-428c-a181-3a7a1cd40fbc service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "dd545b80-aca7-4c39-a8ed-fcfc420bcdc0", "tag": "7c48ac85-1f36-4aa6-a58f-e9c059b1c3ac"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:44.217665 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-7fb0743b-a461-4010-a903-789d2194bc3d req-3e94176d-c3ec-428c-a181-3a7a1cd40fbc service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:44.218204 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-7fb0743b-a461-4010-a903-789d2194bc3d req-3e94176d-c3ec-428c-a181-3a7a1cd40fbc service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:44.232487 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-7fb0743b-a461-4010-a903-789d2194bc3d req-3e94176d-c3ec-428c-a181-3a7a1cd40fbc service nova] Creating event network-changed:7c48ac85-1f36-4aa6-a58f-e9c059b1c3ac for instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 on hv-cinder-84841 Jul 25 06:07:44.238171 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-7fb0743b-a461-4010-a903-789d2194bc3d req-3e94176d-c3ec-428c-a181-3a7a1cd40fbc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037028 Jul 25 06:07:44.238808 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 541/1087] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:44.328572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-712e3a00-f5e7-46a8-a076-b5a7d3742989 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:44.329183 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-712e3a00-f5e7-46a8-a076-b5a7d3742989 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:44.336205 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-712e3a00-f5e7-46a8-a076-b5a7d3742989 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:44.336652 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-712e3a00-f5e7-46a8-a076-b5a7d3742989 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:44.337645 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-712e3a00-f5e7-46a8-a076-b5a7d3742989 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:44.338078 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-712e3a00-f5e7-46a8-a076-b5a7d3742989 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:44.488260 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-712e3a00-f5e7-46a8-a076-b5a7d3742989 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:44.495658 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-712e3a00-f5e7-46a8-a076-b5a7d3742989 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1278 microversion: 2.1 time: 0.171087 Jul 25 06:07:44.496276 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 547/1088] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:44 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:45.510611 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=6 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:45.516286 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-639c81d9-1931-4ba5-a763-725158da7d72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:45.517005 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-639c81d9-1931-4ba5-a763-725158da7d72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:45.523293 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-639c81d9-1931-4ba5-a763-725158da7d72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:45.523738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-639c81d9-1931-4ba5-a763-725158da7d72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:45.524817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-639c81d9-1931-4ba5-a763-725158da7d72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:45.525246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-639c81d9-1931-4ba5-a763-725158da7d72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:45.673372 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-639c81d9-1931-4ba5-a763-725158da7d72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:45.680822 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-639c81d9-1931-4ba5-a763-725158da7d72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1278 microversion: 2.1 time: 0.171994 Jul 25 06:07:45.681382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 542/1089] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:45 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:46.700361 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1f75e34a-552a-450f-b51d-51428c529c69 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:46.701807 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1f75e34a-552a-450f-b51d-51428c529c69 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:46.703909 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:46.704601 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=6 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:46.710034 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f75e34a-552a-450f-b51d-51428c529c69 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:46.710477 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f75e34a-552a-450f-b51d-51428c529c69 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:46.711236 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f75e34a-552a-450f-b51d-51428c529c69 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:46.711669 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1f75e34a-552a-450f-b51d-51428c529c69 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:46.848099 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1f75e34a-552a-450f-b51d-51428c529c69 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:46.855722 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1f75e34a-552a-450f-b51d-51428c529c69 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1266 microversion: 2.1 time: 0.161072 Jul 25 06:07:46.856307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 548/1090] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:46 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:47.877368 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2e4d99b2-97f7-4283-b05e-87227a77f38c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:47.878011 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2e4d99b2-97f7-4283-b05e-87227a77f38c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:47.884428 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2e4d99b2-97f7-4283-b05e-87227a77f38c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:47.884878 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2e4d99b2-97f7-4283-b05e-87227a77f38c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:47.885638 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2e4d99b2-97f7-4283-b05e-87227a77f38c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:47.886072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2e4d99b2-97f7-4283-b05e-87227a77f38c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:48.017731 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2e4d99b2-97f7-4283-b05e-87227a77f38c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:48.025484 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2e4d99b2-97f7-4283-b05e-87227a77f38c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1266 microversion: 2.1 time: 0.152769 Jul 25 06:07:48.025988 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 543/1091] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:47 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:49.042840 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c0593567-7e0b-4a6d-ae01-effb5256dd4f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:49.043492 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c0593567-7e0b-4a6d-ae01-effb5256dd4f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:49.050663 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c0593567-7e0b-4a6d-ae01-effb5256dd4f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:49.051096 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c0593567-7e0b-4a6d-ae01-effb5256dd4f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:49.051949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c0593567-7e0b-4a6d-ae01-effb5256dd4f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:49.052597 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c0593567-7e0b-4a6d-ae01-effb5256dd4f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:49.201996 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c0593567-7e0b-4a6d-ae01-effb5256dd4f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:49.206493 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c0593567-7e0b-4a6d-ae01-effb5256dd4f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1266 microversion: 2.1 time: 0.167576 Jul 25 06:07:49.207383 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 549/1092] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:49 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:50.223738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ec8e52f4-60ea-4c99-855f-9cf2f065a311 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:50.224384 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ec8e52f4-60ea-4c99-855f-9cf2f065a311 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:50.230890 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec8e52f4-60ea-4c99-855f-9cf2f065a311 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:50.231340 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec8e52f4-60ea-4c99-855f-9cf2f065a311 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:50.232187 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec8e52f4-60ea-4c99-855f-9cf2f065a311 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:50.232625 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ec8e52f4-60ea-4c99-855f-9cf2f065a311 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:50.371607 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ec8e52f4-60ea-4c99-855f-9cf2f065a311 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:50.379241 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ec8e52f4-60ea-4c99-855f-9cf2f065a311 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1266 microversion: 2.1 time: 0.159341 Jul 25 06:07:50.379806 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 544/1093] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:50 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:51.397011 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d4dcefa1-505f-4483-b0f0-d93e55bac639 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:51.397688 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d4dcefa1-505f-4483-b0f0-d93e55bac639 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:51.405282 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d4dcefa1-505f-4483-b0f0-d93e55bac639 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:51.415000 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d4dcefa1-505f-4483-b0f0-d93e55bac639 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:51.415000 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d4dcefa1-505f-4483-b0f0-d93e55bac639 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:51.415000 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d4dcefa1-505f-4483-b0f0-d93e55bac639 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:51.548091 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d4dcefa1-505f-4483-b0f0-d93e55bac639 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:51.555745 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d4dcefa1-505f-4483-b0f0-d93e55bac639 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1266 microversion: 2.1 time: 0.162546 Jul 25 06:07:51.558887 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 550/1094] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:51 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:52.573561 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5b086b72-9474-4b23-b1cb-2756f91e5b64 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:52.574109 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5b086b72-9474-4b23-b1cb-2756f91e5b64 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:52.582736 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5b086b72-9474-4b23-b1cb-2756f91e5b64 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:52.583214 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5b086b72-9474-4b23-b1cb-2756f91e5b64 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:52.583984 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5b086b72-9474-4b23-b1cb-2756f91e5b64 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:52.584486 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5b086b72-9474-4b23-b1cb-2756f91e5b64 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:52.723035 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5b086b72-9474-4b23-b1cb-2756f91e5b64 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:52.730422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5b086b72-9474-4b23-b1cb-2756f91e5b64 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1266 microversion: 2.1 time: 0.160896 Jul 25 06:07:52.730975 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 545/1095] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:52 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:53.747275 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-6927e739-5a98-4dc0-a369-3fc6ec7aaa08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:53.748186 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-6927e739-5a98-4dc0-a369-3fc6ec7aaa08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:53.755962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6927e739-5a98-4dc0-a369-3fc6ec7aaa08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:53.756717 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6927e739-5a98-4dc0-a369-3fc6ec7aaa08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:53.757571 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6927e739-5a98-4dc0-a369-3fc6ec7aaa08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:53.758116 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-6927e739-5a98-4dc0-a369-3fc6ec7aaa08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:53.896810 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-6927e739-5a98-4dc0-a369-3fc6ec7aaa08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:53.904439 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-6927e739-5a98-4dc0-a369-3fc6ec7aaa08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1266 microversion: 2.1 time: 0.161221 Jul 25 06:07:53.905002 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 551/1096] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:53 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:54.921917 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-81772a52-55c5-45a7-be82-6e3056b4d960 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:54.922620 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-81772a52-55c5-45a7-be82-6e3056b4d960 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:54.930102 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-81772a52-55c5-45a7-be82-6e3056b4d960 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:54.935960 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-81772a52-55c5-45a7-be82-6e3056b4d960 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:54.935960 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-81772a52-55c5-45a7-be82-6e3056b4d960 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:54.935960 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-81772a52-55c5-45a7-be82-6e3056b4d960 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:55.073759 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-81772a52-55c5-45a7-be82-6e3056b4d960 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:55.081201 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-81772a52-55c5-45a7-be82-6e3056b4d960 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1266 microversion: 2.1 time: 0.163220 Jul 25 06:07:55.081756 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 546/1097] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:54 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:56.098976 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ed95ccb7-a35a-442a-91a3-c6e708c4aab2 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:56.099636 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ed95ccb7-a35a-442a-91a3-c6e708c4aab2 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:56.106127 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ed95ccb7-a35a-442a-91a3-c6e708c4aab2 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:56.106580 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ed95ccb7-a35a-442a-91a3-c6e708c4aab2 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:56.107352 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ed95ccb7-a35a-442a-91a3-c6e708c4aab2 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:56.107793 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ed95ccb7-a35a-442a-91a3-c6e708c4aab2 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:56.241675 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ed95ccb7-a35a-442a-91a3-c6e708c4aab2 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:56.249169 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ed95ccb7-a35a-442a-91a3-c6e708c4aab2 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1266 microversion: 2.1 time: 0.154552 Jul 25 06:07:56.249730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 552/1098] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:56 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:57.265727 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-66314667-f50e-4b7a-8b4f-7940e210a830 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:57.266342 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-66314667-f50e-4b7a-8b4f-7940e210a830 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:57.273663 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-66314667-f50e-4b7a-8b4f-7940e210a830 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:57.274134 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-66314667-f50e-4b7a-8b4f-7940e210a830 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:57.275286 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-66314667-f50e-4b7a-8b4f-7940e210a830 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:57.275727 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-66314667-f50e-4b7a-8b4f-7940e210a830 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:57.413947 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-66314667-f50e-4b7a-8b4f-7940e210a830 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:57.421992 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-66314667-f50e-4b7a-8b4f-7940e210a830 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1266 microversion: 2.1 time: 0.160204 Jul 25 06:07:57.422570 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 547/1099] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:57 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:57.542156 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-198486e9-faff-4466-81c5-49931c39dd08 req-ae5da5ca-a390-49d4-ad06-d3c7ae408c59 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "dd545b80-aca7-4c39-a8ed-fcfc420bcdc0", "name": "network-vif-plugged", "status": "completed", "tag": "7c48ac85-1f36-4aa6-a58f-e9c059b1c3ac"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:57.555612 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-198486e9-faff-4466-81c5-49931c39dd08 req-ae5da5ca-a390-49d4-ad06-d3c7ae408c59 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:57.556075 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-198486e9-faff-4466-81c5-49931c39dd08 req-ae5da5ca-a390-49d4-ad06-d3c7ae408c59 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:57.570006 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-198486e9-faff-4466-81c5-49931c39dd08 req-ae5da5ca-a390-49d4-ad06-d3c7ae408c59 service nova] Creating event network-vif-plugged:7c48ac85-1f36-4aa6-a58f-e9c059b1c3ac for instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 on hv-cinder-84841 Jul 25 06:07:57.573739 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-198486e9-faff-4466-81c5-49931c39dd08 req-ae5da5ca-a390-49d4-ad06-d3c7ae408c59 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035345 Jul 25 06:07:57.574522 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 553/1100] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:07:58.438781 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-79765434-832d-4c4d-8f82-ad9511f3ac98 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:58.439368 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-79765434-832d-4c4d-8f82-ad9511f3ac98 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:58.445955 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-79765434-832d-4c4d-8f82-ad9511f3ac98 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:58.446400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-79765434-832d-4c4d-8f82-ad9511f3ac98 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:58.447154 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-79765434-832d-4c4d-8f82-ad9511f3ac98 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:58.447587 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-79765434-832d-4c4d-8f82-ad9511f3ac98 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:58.586373 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-79765434-832d-4c4d-8f82-ad9511f3ac98 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:58.593798 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-79765434-832d-4c4d-8f82-ad9511f3ac98 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1266 microversion: 2.1 time: 0.158915 Jul 25 06:07:58.600268 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 548/1101] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:58 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:59.616140 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c9967091-95cc-4675-ba9a-d7a7d7b8be22 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:59.616779 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c9967091-95cc-4675-ba9a-d7a7d7b8be22 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:59.623312 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9967091-95cc-4675-ba9a-d7a7d7b8be22 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:59.623766 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9967091-95cc-4675-ba9a-d7a7d7b8be22 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:59.624562 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9967091-95cc-4675-ba9a-d7a7d7b8be22 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:59.625067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9967091-95cc-4675-ba9a-d7a7d7b8be22 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:59.702934 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-TestShelveInstance-server-1946379306", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1968237889", "security_groups": [{"name": "tempest-secgroup-smoke-2052956951"}], "networks": [{"uuid": "c6e0d702-8c0d-4f55-a895-c3df29202603"}], "block_device_mapping_v2": [{"uuid": "b920b80c-bbcf-416a-b039-797bb6bf6b60", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:07:59.768843 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c9967091-95cc-4675-ba9a-d7a7d7b8be22 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:59.777184 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c9967091-95cc-4675-ba9a-d7a7d7b8be22 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1452 microversion: 2.1 time: 0.166028 Jul 25 06:07:59.777806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 554/1102] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:59 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:07:59.793952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0f788bda-7fbe-473d-b383-fb44c281708b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:07:59.794567 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-0f788bda-7fbe-473d-b383-fb44c281708b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:07:59.800925 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0f788bda-7fbe-473d-b383-fb44c281708b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:59.801297 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0f788bda-7fbe-473d-b383-fb44c281708b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:59.805458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0f788bda-7fbe-473d-b383-fb44c281708b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:07:59.805458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0f788bda-7fbe-473d-b383-fb44c281708b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:07:59.834088 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] validate_networks() for [('c6e0d702-8c0d-4f55-a895-c3df29202603', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:07:59.947486 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-0f788bda-7fbe-473d-b383-fb44c281708b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:07:59.955573 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0f788bda-7fbe-473d-b383-fb44c281708b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1452 microversion: 2.1 time: 0.165429 Jul 25 06:07:59.956175 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 555/1103] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:07:59 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:08:00.307908 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:08:00.308382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:08:00.308858 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:08:00.309363 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:08:00.309892 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:08:00.319118 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:00.319559 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:00.320472 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:00.320903 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:00.339490 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Getting quotas for project 3520876da8974c439cef1b35397029f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:08:00.343953 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Getting quotas for user 3eca908cd8a1481c9e4c11036cd4df7b and project 3520876da8974c439cef1b35397029f9. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:08:00.413514 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:08:00.413741 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=True,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='b920b80c-bbcf-416a-b039-797bb6bf6b60',volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:08:00.867155 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-e26433f0-6536-4208-828f-9f57d7a5f454 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.168034 Jul 25 06:08:00.873258 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 549/1104] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:07:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 06:08:00.879336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-a31c4cd3-de37-4d3f-a5d4-9df18f81cd71 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:00.879791 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-a31c4cd3-de37-4d3f-a5d4-9df18f81cd71 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:00.955265 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-a31c4cd3-de37-4d3f-a5d4-9df18f81cd71 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:00.964053 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-a31c4cd3-de37-4d3f-a5d4-9df18f81cd71 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1089 microversion: 2.1 time: 0.089290 Jul 25 06:08:00.964654 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 556/1105] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:00 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1089 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:01.982910 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-abbd5bb3-33f9-4da4-8333-7f03a1fff2bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:01.983530 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-abbd5bb3-33f9-4da4-8333-7f03a1fff2bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:01.985655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:01.990971 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-abbd5bb3-33f9-4da4-8333-7f03a1fff2bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:01.991513 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-abbd5bb3-33f9-4da4-8333-7f03a1fff2bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:01.992313 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-abbd5bb3-33f9-4da4-8333-7f03a1fff2bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:01.992776 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-abbd5bb3-33f9-4da4-8333-7f03a1fff2bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:01.996947 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=65 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:02.065268 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-abbd5bb3-33f9-4da4-8333-7f03a1fff2bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:02.074299 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-abbd5bb3-33f9-4da4-8333-7f03a1fff2bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1139 microversion: 2.1 time: 0.096003 Jul 25 06:08:02.074871 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 550/1106] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:01 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1139 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:02.281215 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-a6261d58-3fca-483f-b2a6-cd46b661b396 req-1a0ed1f9-17d7-48e4-bfd4-1a15d765a3e9 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "dd545b80-aca7-4c39-a8ed-fcfc420bcdc0", "tag": "7c48ac85-1f36-4aa6-a58f-e9c059b1c3ac"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:02.291440 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-a6261d58-3fca-483f-b2a6-cd46b661b396 req-1a0ed1f9-17d7-48e4-bfd4-1a15d765a3e9 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:02.291896 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-a6261d58-3fca-483f-b2a6-cd46b661b396 req-1a0ed1f9-17d7-48e4-bfd4-1a15d765a3e9 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:02.302743 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-a6261d58-3fca-483f-b2a6-cd46b661b396 req-1a0ed1f9-17d7-48e4-bfd4-1a15d765a3e9 service nova] Creating event network-changed:7c48ac85-1f36-4aa6-a58f-e9c059b1c3ac for instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 on hv-cinder-84841 Jul 25 06:08:02.310413 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-a6261d58-3fca-483f-b2a6-cd46b661b396 req-1a0ed1f9-17d7-48e4-bfd4-1a15d765a3e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033067 Jul 25 06:08:02.311326 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 557/1107] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:08:03.092278 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5af19daa-3fac-497a-91f3-6458f7edb9e9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:03.093777 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5af19daa-3fac-497a-91f3-6458f7edb9e9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:03.105013 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5af19daa-3fac-497a-91f3-6458f7edb9e9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:03.105481 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5af19daa-3fac-497a-91f3-6458f7edb9e9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:03.106267 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5af19daa-3fac-497a-91f3-6458f7edb9e9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:03.106788 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5af19daa-3fac-497a-91f3-6458f7edb9e9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:03.265252 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5af19daa-3fac-497a-91f3-6458f7edb9e9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:03.275135 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5af19daa-3fac-497a-91f3-6458f7edb9e9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1195 microversion: 2.1 time: 0.187434 Jul 25 06:08:03.275733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 551/1108] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:03 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1195 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:04.293213 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-10ed8851-2a81-4773-a0c2-c57835d952d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:04.296297 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-10ed8851-2a81-4773-a0c2-c57835d952d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:04.309420 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-10ed8851-2a81-4773-a0c2-c57835d952d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:04.309804 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-10ed8851-2a81-4773-a0c2-c57835d952d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:04.311233 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-10ed8851-2a81-4773-a0c2-c57835d952d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:04.311759 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-10ed8851-2a81-4773-a0c2-c57835d952d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:04.465099 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-10ed8851-2a81-4773-a0c2-c57835d952d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:04.473288 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-10ed8851-2a81-4773-a0c2-c57835d952d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1273 microversion: 2.1 time: 0.185108 Jul 25 06:08:04.473845 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 558/1109] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:04 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:05.025654 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-44358b58-3a25-455c-b7df-15214f53afc4 req-95a77224-9667-4ea4-b9bb-447fe20381c6 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b", "tag": "58a00c23-3e4e-4b24-9a79-d8fb739d245a"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:05.034412 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-44358b58-3a25-455c-b7df-15214f53afc4 req-95a77224-9667-4ea4-b9bb-447fe20381c6 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:05.034859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-44358b58-3a25-455c-b7df-15214f53afc4 req-95a77224-9667-4ea4-b9bb-447fe20381c6 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:05.047124 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-44358b58-3a25-455c-b7df-15214f53afc4 req-95a77224-9667-4ea4-b9bb-447fe20381c6 service nova] Creating event network-changed:58a00c23-3e4e-4b24-9a79-d8fb739d245a for instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b on hv-cinder-84841 Jul 25 06:08:05.052585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-44358b58-3a25-455c-b7df-15214f53afc4 req-95a77224-9667-4ea4-b9bb-447fe20381c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031451 Jul 25 06:08:05.053477 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 552/1110] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:08:05.490937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-568dbd5c-9522-4c1c-8f76-3661a9de65b1 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:05.492284 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-568dbd5c-9522-4c1c-8f76-3661a9de65b1 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:05.494727 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:05.499730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-568dbd5c-9522-4c1c-8f76-3661a9de65b1 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:05.500212 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-568dbd5c-9522-4c1c-8f76-3661a9de65b1 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:05.500996 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-568dbd5c-9522-4c1c-8f76-3661a9de65b1 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:05.501431 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-568dbd5c-9522-4c1c-8f76-3661a9de65b1 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:05.505793 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=85 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:05.647176 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-568dbd5c-9522-4c1c-8f76-3661a9de65b1 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:05.657809 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-568dbd5c-9522-4c1c-8f76-3661a9de65b1 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.170805 Jul 25 06:08:05.658879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 559/1111] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:05 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:06.675118 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ca3ede20-7036-4f98-b710-1a9903fb4b39 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:06.675817 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ca3ede20-7036-4f98-b710-1a9903fb4b39 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:06.682737 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ca3ede20-7036-4f98-b710-1a9903fb4b39 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:06.683183 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ca3ede20-7036-4f98-b710-1a9903fb4b39 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:06.683942 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ca3ede20-7036-4f98-b710-1a9903fb4b39 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:06.684532 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ca3ede20-7036-4f98-b710-1a9903fb4b39 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:06.829036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-ca3ede20-7036-4f98-b710-1a9903fb4b39 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:06.837967 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ca3ede20-7036-4f98-b710-1a9903fb4b39 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.167001 Jul 25 06:08:06.838558 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 553/1112] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:06 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:07.855059 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-e46e4bd0-3dd5-42bc-a5e4-f171af0f65cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:07.855662 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-e46e4bd0-3dd5-42bc-a5e4-f171af0f65cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:07.864374 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e46e4bd0-3dd5-42bc-a5e4-f171af0f65cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:07.864827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e46e4bd0-3dd5-42bc-a5e4-f171af0f65cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:07.865585 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e46e4bd0-3dd5-42bc-a5e4-f171af0f65cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:07.866010 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-e46e4bd0-3dd5-42bc-a5e4-f171af0f65cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:08.001409 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-e46e4bd0-3dd5-42bc-a5e4-f171af0f65cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:08.009659 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-e46e4bd0-3dd5-42bc-a5e4-f171af0f65cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.158737 Jul 25 06:08:08.012981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 560/1113] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:07 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:09.027169 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6cac3cc2-bec7-43d9-a28f-01c41a54e940 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:09.027804 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6cac3cc2-bec7-43d9-a28f-01c41a54e940 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:09.034287 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cac3cc2-bec7-43d9-a28f-01c41a54e940 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:09.034730 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cac3cc2-bec7-43d9-a28f-01c41a54e940 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:09.035486 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cac3cc2-bec7-43d9-a28f-01c41a54e940 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:09.035923 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6cac3cc2-bec7-43d9-a28f-01c41a54e940 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:09.166273 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6cac3cc2-bec7-43d9-a28f-01c41a54e940 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:09.173803 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6cac3cc2-bec7-43d9-a28f-01c41a54e940 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.151438 Jul 25 06:08:09.174367 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 554/1114] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:09 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:10.190657 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-f39d1565-1972-4b20-8044-0954a19e12a9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:10.205131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-f39d1565-1972-4b20-8044-0954a19e12a9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:10.205131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f39d1565-1972-4b20-8044-0954a19e12a9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:10.205131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f39d1565-1972-4b20-8044-0954a19e12a9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:10.205131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f39d1565-1972-4b20-8044-0954a19e12a9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:10.205830 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-f39d1565-1972-4b20-8044-0954a19e12a9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:10.338299 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-f39d1565-1972-4b20-8044-0954a19e12a9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:10.345721 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-f39d1565-1972-4b20-8044-0954a19e12a9 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.158958 Jul 25 06:08:10.346279 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 561/1115] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:10 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:11.362797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-bc9a1ad3-c3d6-47e5-b51d-af00d800cf0d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:11.363404 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-bc9a1ad3-c3d6-47e5-b51d-af00d800cf0d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:11.365861 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:11.367227 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=6 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:11.372059 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bc9a1ad3-c3d6-47e5-b51d-af00d800cf0d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:11.372543 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bc9a1ad3-c3d6-47e5-b51d-af00d800cf0d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:11.373290 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bc9a1ad3-c3d6-47e5-b51d-af00d800cf0d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:11.373719 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bc9a1ad3-c3d6-47e5-b51d-af00d800cf0d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:11.507380 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-bc9a1ad3-c3d6-47e5-b51d-af00d800cf0d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:11.514838 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-bc9a1ad3-c3d6-47e5-b51d-af00d800cf0d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.156040 Jul 25 06:08:11.515390 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 555/1116] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:11 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:12.532200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-600a6a2c-cff9-4af1-a7b8-ac496d6f8b09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:12.532824 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-600a6a2c-cff9-4af1-a7b8-ac496d6f8b09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:12.534656 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:08:12.540037 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-600a6a2c-cff9-4af1-a7b8-ac496d6f8b09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:12.540519 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-600a6a2c-cff9-4af1-a7b8-ac496d6f8b09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:12.541291 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-600a6a2c-cff9-4af1-a7b8-ac496d6f8b09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:12.541725 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-600a6a2c-cff9-4af1-a7b8-ac496d6f8b09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:12.677975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-600a6a2c-cff9-4af1-a7b8-ac496d6f8b09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:12.686326 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-600a6a2c-cff9-4af1-a7b8-ac496d6f8b09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.158021 Jul 25 06:08:12.686896 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 562/1117] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:12 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:13.703137 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4654b36c-3886-421c-add8-f59ca7047b2c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:13.703680 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4654b36c-3886-421c-add8-f59ca7047b2c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:13.710588 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4654b36c-3886-421c-add8-f59ca7047b2c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:13.711072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4654b36c-3886-421c-add8-f59ca7047b2c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:13.712664 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4654b36c-3886-421c-add8-f59ca7047b2c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:13.713403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4654b36c-3886-421c-add8-f59ca7047b2c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:13.846955 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4654b36c-3886-421c-add8-f59ca7047b2c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:13.854821 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4654b36c-3886-421c-add8-f59ca7047b2c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.155905 Jul 25 06:08:13.855603 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 556/1118] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:13 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:14.870835 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ccc8d9ce-9206-49c8-865d-314376ff5d1f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:14.871447 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ccc8d9ce-9206-49c8-865d-314376ff5d1f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:14.877944 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ccc8d9ce-9206-49c8-865d-314376ff5d1f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:14.878389 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ccc8d9ce-9206-49c8-865d-314376ff5d1f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:14.879151 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ccc8d9ce-9206-49c8-865d-314376ff5d1f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:14.879584 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ccc8d9ce-9206-49c8-865d-314376ff5d1f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:15.014479 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ccc8d9ce-9206-49c8-865d-314376ff5d1f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:15.022351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ccc8d9ce-9206-49c8-865d-314376ff5d1f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.155328 Jul 25 06:08:15.024808 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 563/1119] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:14 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:15.647939 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-95233ec0-b977-40c6-bf2c-eb78471f7ca4 req-5b3b8048-dfe1-4e86-9265-3279e00672e5 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b", "name": "network-vif-plugged", "status": "completed", "tag": "58a00c23-3e4e-4b24-9a79-d8fb739d245a"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:15.657285 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-95233ec0-b977-40c6-bf2c-eb78471f7ca4 req-5b3b8048-dfe1-4e86-9265-3279e00672e5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:15.657730 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-95233ec0-b977-40c6-bf2c-eb78471f7ca4 req-5b3b8048-dfe1-4e86-9265-3279e00672e5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:15.671601 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-95233ec0-b977-40c6-bf2c-eb78471f7ca4 req-5b3b8048-dfe1-4e86-9265-3279e00672e5 service nova] Creating event network-vif-plugged:58a00c23-3e4e-4b24-9a79-d8fb739d245a for instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b on hv-cinder-84841 Jul 25 06:08:15.676416 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-95233ec0-b977-40c6-bf2c-eb78471f7ca4 req-5b3b8048-dfe1-4e86-9265-3279e00672e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033053 Jul 25 06:08:15.677002 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 557/1120] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:08:16.041709 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-efef3309-ac14-4e98-bbc9-81402491137b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:16.042989 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-efef3309-ac14-4e98-bbc9-81402491137b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:16.050182 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-efef3309-ac14-4e98-bbc9-81402491137b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:16.050768 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-efef3309-ac14-4e98-bbc9-81402491137b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:16.053862 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-efef3309-ac14-4e98-bbc9-81402491137b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:16.053862 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-efef3309-ac14-4e98-bbc9-81402491137b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:16.191046 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-efef3309-ac14-4e98-bbc9-81402491137b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:16.199440 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-efef3309-ac14-4e98-bbc9-81402491137b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.162377 Jul 25 06:08:16.200012 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 564/1121] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:16 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:17.218205 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d880c43f-e6d6-49ed-9a4f-b65675b9abc2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:17.218912 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d880c43f-e6d6-49ed-9a4f-b65675b9abc2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:17.225188 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d880c43f-e6d6-49ed-9a4f-b65675b9abc2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:17.225634 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d880c43f-e6d6-49ed-9a4f-b65675b9abc2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:17.226400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d880c43f-e6d6-49ed-9a4f-b65675b9abc2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:17.226903 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d880c43f-e6d6-49ed-9a4f-b65675b9abc2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:17.361516 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d880c43f-e6d6-49ed-9a4f-b65675b9abc2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:17.370033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d880c43f-e6d6-49ed-9a4f-b65675b9abc2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.156559 Jul 25 06:08:17.370743 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 558/1122] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:17 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:18.387796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-06be6f5d-a76d-46ab-88a9-8e81b7729b6b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:18.388438 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-06be6f5d-a76d-46ab-88a9-8e81b7729b6b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:18.396882 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06be6f5d-a76d-46ab-88a9-8e81b7729b6b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:18.397327 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06be6f5d-a76d-46ab-88a9-8e81b7729b6b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:18.398086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06be6f5d-a76d-46ab-88a9-8e81b7729b6b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:18.398514 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06be6f5d-a76d-46ab-88a9-8e81b7729b6b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:18.536004 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-06be6f5d-a76d-46ab-88a9-8e81b7729b6b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:18.544590 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-06be6f5d-a76d-46ab-88a9-8e81b7729b6b tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.161734 Jul 25 06:08:18.545164 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 565/1123] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:18 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:19.561712 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6e38fd6f-6f63-449e-948b-40878b6d3de8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:19.562331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6e38fd6f-6f63-449e-948b-40878b6d3de8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:19.569098 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e38fd6f-6f63-449e-948b-40878b6d3de8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:19.569554 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e38fd6f-6f63-449e-948b-40878b6d3de8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:19.570324 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e38fd6f-6f63-449e-948b-40878b6d3de8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:19.570786 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6e38fd6f-6f63-449e-948b-40878b6d3de8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:19.708782 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6e38fd6f-6f63-449e-948b-40878b6d3de8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:19.718664 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6e38fd6f-6f63-449e-948b-40878b6d3de8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1261 microversion: 2.1 time: 0.157624 Jul 25 06:08:19.718664 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 559/1124] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:19 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:20.732859 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-35e8a025-9d6a-483b-b76d-184614da0806 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:20.733464 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-35e8a025-9d6a-483b-b76d-184614da0806 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:20.740090 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-35e8a025-9d6a-483b-b76d-184614da0806 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:20.740560 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-35e8a025-9d6a-483b-b76d-184614da0806 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:20.741316 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-35e8a025-9d6a-483b-b76d-184614da0806 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:20.741743 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-35e8a025-9d6a-483b-b76d-184614da0806 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:20.879067 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-35e8a025-9d6a-483b-b76d-184614da0806 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:20.887143 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-35e8a025-9d6a-483b-b76d-184614da0806 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1446 microversion: 2.1 time: 0.158196 Jul 25 06:08:20.887721 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 566/1125] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:20 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:08:20.906965 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-375d8e09-b8b1-4bfc-9cde-63eb677d496f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:08:20.907581 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-375d8e09-b8b1-4bfc-9cde-63eb677d496f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:08:20.914101 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-375d8e09-b8b1-4bfc-9cde-63eb677d496f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:20.915208 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-375d8e09-b8b1-4bfc-9cde-63eb677d496f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:20.916198 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-375d8e09-b8b1-4bfc-9cde-63eb677d496f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:20.916628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-375d8e09-b8b1-4bfc-9cde-63eb677d496f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:21.073065 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-375d8e09-b8b1-4bfc-9cde-63eb677d496f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:08:21.081423 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-375d8e09-b8b1-4bfc-9cde-63eb677d496f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1446 microversion: 2.1 time: 0.178684 Jul 25 06:08:21.085218 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 560/1126] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:08:20 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1446 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:08:23.537143 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-0aa72139-5f0f-49a8-9114-6334e263e2f7 req-45392a4c-fbd2-4909-af3a-2c3b060a55e7 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b", "tag": "58a00c23-3e4e-4b24-9a79-d8fb739d245a"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:08:23.547223 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-0aa72139-5f0f-49a8-9114-6334e263e2f7 req-45392a4c-fbd2-4909-af3a-2c3b060a55e7 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:08:23.547859 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-0aa72139-5f0f-49a8-9114-6334e263e2f7 req-45392a4c-fbd2-4909-af3a-2c3b060a55e7 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:08:23.560428 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-0aa72139-5f0f-49a8-9114-6334e263e2f7 req-45392a4c-fbd2-4909-af3a-2c3b060a55e7 service nova] Creating event network-changed:58a00c23-3e4e-4b24-9a79-d8fb739d245a for instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b on hv-cinder-84841 Jul 25 06:08:23.565705 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-0aa72139-5f0f-49a8-9114-6334e263e2f7 req-45392a4c-fbd2-4909-af3a-2c3b060a55e7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033552 Jul 25 06:08:23.566802 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 567/1127] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:09:34.367514 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 25 06:09:34.368256 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Mon Jul 25 06:09:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:09:47.130808 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 25 06:09:47.131496 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Mon Jul 25 06:09:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:10:01.196238 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=21 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:01.197011 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=57 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:01.200925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-bddc9d7c-59aa-4011-ad70-53970ddcce52 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:01.201424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-bddc9d7c-59aa-4011-ad70-53970ddcce52 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:01.207242 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bddc9d7c-59aa-4011-ad70-53970ddcce52 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:01.210008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bddc9d7c-59aa-4011-ad70-53970ddcce52 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:01.210008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bddc9d7c-59aa-4011-ad70-53970ddcce52 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:01.210008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-bddc9d7c-59aa-4011-ad70-53970ddcce52 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:01.235047 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-bddc9d7c-59aa-4011-ad70-53970ddcce52 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Going to try to terminate instance {{(pid=124917) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:10:01.515475 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-bddc9d7c-59aa-4011-ad70-53970ddcce52 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 204 len: 0 microversion: 2.1 time: 0.320869 Jul 25 06:10:01.516069 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 561/1128] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:10:01 2022] DELETE /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:10:01.523461 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58372beb-6bba-4c71-983d-c33b78d909e7] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 06:10:01.524476 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=17 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:01.525257 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=49 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:01.530307 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-0cc53491-3045-4bf8-991f-786027d2b372 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:01.531001 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-0cc53491-3045-4bf8-991f-786027d2b372 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:01.537655 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0cc53491-3045-4bf8-991f-786027d2b372 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:01.538103 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0cc53491-3045-4bf8-991f-786027d2b372 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:01.538920 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0cc53491-3045-4bf8-991f-786027d2b372 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:01.539352 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-0cc53491-3045-4bf8-991f-786027d2b372 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:01.825229 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-0cc53491-3045-4bf8-991f-786027d2b372 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:01.832834 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-0cc53491-3045-4bf8-991f-786027d2b372 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1576 microversion: 2.1 time: 0.312163 Jul 25 06:10:01.833591 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 568/1129] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:01 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1576 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:02.850346 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-4edb0f44-1410-4bde-a803-4a4e9afee4a1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:02.851054 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-4edb0f44-1410-4bde-a803-4a4e9afee4a1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:02.858531 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4edb0f44-1410-4bde-a803-4a4e9afee4a1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:02.858980 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4edb0f44-1410-4bde-a803-4a4e9afee4a1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:02.859744 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4edb0f44-1410-4bde-a803-4a4e9afee4a1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:02.860208 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-4edb0f44-1410-4bde-a803-4a4e9afee4a1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:03.052502 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-4edb0f44-1410-4bde-a803-4a4e9afee4a1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:03.059995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-4edb0f44-1410-4bde-a803-4a4e9afee4a1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1576 microversion: 2.1 time: 0.213953 Jul 25 06:10:03.060597 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 562/1130] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:02 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:03.922331 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-c481e7b7-c04b-4cb6-b75e-514d8ad76444 req-1d68bf8c-e4b2-4bd1-99b4-c6f1f351f06c service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "dd545b80-aca7-4c39-a8ed-fcfc420bcdc0", "name": "network-vif-deleted", "tag": "7c48ac85-1f36-4aa6-a58f-e9c059b1c3ac"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:03.937723 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO oslo.messaging._drivers.impl_rabbit [-] [58372beb-6bba-4c71-983d-c33b78d909e7] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 42068. Jul 25 06:10:03.940308 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-c481e7b7-c04b-4cb6-b75e-514d8ad76444 req-1d68bf8c-e4b2-4bd1-99b4-c6f1f351f06c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:03.940788 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-c481e7b7-c04b-4cb6-b75e-514d8ad76444 req-1d68bf8c-e4b2-4bd1-99b4-c6f1f351f06c service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:03.952434 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-c481e7b7-c04b-4cb6-b75e-514d8ad76444 req-1d68bf8c-e4b2-4bd1-99b4-c6f1f351f06c service nova] Creating event network-vif-deleted:7c48ac85-1f36-4aa6-a58f-e9c059b1c3ac for instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 on hv-cinder-84841 Jul 25 06:10:03.957553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-c481e7b7-c04b-4cb6-b75e-514d8ad76444 req-1d68bf8c-e4b2-4bd1-99b4-c6f1f351f06c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040684 Jul 25 06:10:03.958354 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 569/1131] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 06:10:04.077454 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-42c200dd-3f6b-4919-ae7e-26e5f3e87c04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:04.078076 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-42c200dd-3f6b-4919-ae7e-26e5f3e87c04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:04.093768 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42c200dd-3f6b-4919-ae7e-26e5f3e87c04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:04.093768 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42c200dd-3f6b-4919-ae7e-26e5f3e87c04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:04.093768 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42c200dd-3f6b-4919-ae7e-26e5f3e87c04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:04.093768 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-42c200dd-3f6b-4919-ae7e-26e5f3e87c04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:04.165900 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-42c200dd-3f6b-4919-ae7e-26e5f3e87c04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:04.174589 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-42c200dd-3f6b-4919-ae7e-26e5f3e87c04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 200 len: 1225 microversion: 2.1 time: 0.101270 Jul 25 06:10:04.175271 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 563/1132] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:04 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:05.192231 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-67f58898-dbc7-4c93-b31d-0d2e4dd449da tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:05.193051 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-67f58898-dbc7-4c93-b31d-0d2e4dd449da tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:05.200026 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-67f58898-dbc7-4c93-b31d-0d2e4dd449da tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:05.200511 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-67f58898-dbc7-4c93-b31d-0d2e4dd449da tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:05.201278 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-67f58898-dbc7-4c93-b31d-0d2e4dd449da tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:05.201719 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-67f58898-dbc7-4c93-b31d-0d2e4dd449da tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:05.215754 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-67f58898-dbc7-4c93-b31d-0d2e4dd449da tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] HTTP exception thrown: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-67f58898-dbc7-4c93-b31d-0d2e4dd449da tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Request method failure captured: Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 HTTP/1.1 Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jMBDiCp4qexhWETuF6YgbGWHx25oujjO-EQxNn7oOsltyIObOTEUEB6LEI2mokPkkR-T6YRdZVrrjxz32azqZu3DeKysUvPCk3mDw7B3pOwddrOmlfNBIAkhZ1Leny3CNhHRz-3QYHnfUNNmKOes1TjpyXtHZiEoRCB5y88YlLmrIM Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: d275686dbcfc44769065d5d9ba1a6f0c Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-TestVolumeBootPattern-27640003 Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:10:05.218200 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d275686dbcfc44769065d5d9ba1a6f0c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-TestVolumeBootPattern-27640003 Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: d275686dbcfc44769065d5d9ba1a6f0c Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-TestVolumeBootPattern-27640003 Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-TestVolumeBootPattern-27640003-project Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 86335999e9744e4c815a628607618b4f Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-TestVolumeBootPattern-27640003-project Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>> Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:10:05.219892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'dd545b80-aca7-4c39-a8ed-fcfc420bcdc0'} Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:10:05.220956 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:10:05.222559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:10:05.223962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-67f58898-dbc7-4c93-b31d-0d2e4dd449da tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Returning 404 to user: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:10:05.223962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-67f58898-dbc7-4c93-b31d-0d2e4dd449da tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 404 len: 111 microversion: 2.1 time: 0.031197 Jul 25 06:10:05.223962 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 570/1133] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:05 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:10:05.316396 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1125235511", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1193999269", "security_groups": [{"name": "tempest-secgroup-smoke-1525845504"}], "block_device_mapping_v2": [{"uuid": "8af6e1c5-7fa8-4250-9c4d-dd016d0d6014", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61120c55-35c0-41eb-8aba-884eee11abab"}]}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:05.427573 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] validate_networks() for [('61120c55-35c0-41eb-8aba-884eee11abab', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:10:05.803229 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:10:05.803643 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:10:05.804132 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:10:05.804541 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:10:05.804945 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:10:05.813697 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:05.814137 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:05.814916 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:05.815347 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:05.831460 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Getting quotas for project d275686dbcfc44769065d5d9ba1a6f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:10:05.835394 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Getting quotas for user 86335999e9744e4c815a628607618b4f and project d275686dbcfc44769065d5d9ba1a6f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:10:05.890619 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:10:05.892718 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='8af6e1c5-7fa8-4250-9c4d-dd016d0d6014',volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:10:06.278240 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-91443e45-ca7b-42bb-92ae-671efa300365 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.965102 Jul 25 06:10:06.278894 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 564/1134] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:10:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:10:06.289103 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-2043b53b-1dc0-480b-91e2-37c2ee1a3e59 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:06.291800 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-2043b53b-1dc0-480b-91e2-37c2ee1a3e59 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:06.345766 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-2043b53b-1dc0-480b-91e2-37c2ee1a3e59 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:06.353132 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-2043b53b-1dc0-480b-91e2-37c2ee1a3e59 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1095 microversion: 2.1 time: 0.067957 Jul 25 06:10:06.353690 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 571/1135] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:06 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:07.370901 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3bc0cce0-ea33-455c-918b-ce052f2abb21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:07.372008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3bc0cce0-ea33-455c-918b-ce052f2abb21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:07.378793 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3bc0cce0-ea33-455c-918b-ce052f2abb21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:07.379238 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3bc0cce0-ea33-455c-918b-ce052f2abb21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:07.380022 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3bc0cce0-ea33-455c-918b-ce052f2abb21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:07.380483 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3bc0cce0-ea33-455c-918b-ce052f2abb21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:07.442372 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3bc0cce0-ea33-455c-918b-ce052f2abb21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:07.450572 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3bc0cce0-ea33-455c-918b-ce052f2abb21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1137 microversion: 2.1 time: 0.083943 Jul 25 06:10:07.452646 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 565/1136] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:07 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:08.467794 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-63b2da80-f041-45fc-9c2b-bdea87596f31 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:08.468418 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-63b2da80-f041-45fc-9c2b-bdea87596f31 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:08.474861 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-63b2da80-f041-45fc-9c2b-bdea87596f31 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:08.475310 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-63b2da80-f041-45fc-9c2b-bdea87596f31 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:08.476096 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-63b2da80-f041-45fc-9c2b-bdea87596f31 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:08.476546 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-63b2da80-f041-45fc-9c2b-bdea87596f31 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:08.541047 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-63b2da80-f041-45fc-9c2b-bdea87596f31 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:08.550455 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-63b2da80-f041-45fc-9c2b-bdea87596f31 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1211 microversion: 2.1 time: 0.086610 Jul 25 06:10:08.551037 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 572/1137] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:08 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:09.566806 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1e0d9e26-bc98-4f17-b030-1e2941978621 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:09.567426 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1e0d9e26-bc98-4f17-b030-1e2941978621 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:09.579521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1e0d9e26-bc98-4f17-b030-1e2941978621 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:09.579521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1e0d9e26-bc98-4f17-b030-1e2941978621 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:09.579521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1e0d9e26-bc98-4f17-b030-1e2941978621 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:09.579521 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1e0d9e26-bc98-4f17-b030-1e2941978621 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:09.619151 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-939816e4-c737-4747-995d-c5e73bf1ee04 req-d6bda1be-0883-48b9-9959-8be1d3e12184 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "c0bdb7c6-3cf4-4bf6-a67b-3cc406855567", "tag": "73cffae0-d1fe-401f-bf00-2a379c708385"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:09.634427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-939816e4-c737-4747-995d-c5e73bf1ee04 req-d6bda1be-0883-48b9-9959-8be1d3e12184 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:09.635101 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-939816e4-c737-4747-995d-c5e73bf1ee04 req-d6bda1be-0883-48b9-9959-8be1d3e12184 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:09.646963 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-939816e4-c737-4747-995d-c5e73bf1ee04 req-d6bda1be-0883-48b9-9959-8be1d3e12184 service nova] Creating event network-changed:73cffae0-d1fe-401f-bf00-2a379c708385 for instance c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 on hv-cinder-84841 Jul 25 06:10:09.653074 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-939816e4-c737-4747-995d-c5e73bf1ee04 req-d6bda1be-0883-48b9-9959-8be1d3e12184 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037063 Jul 25 06:10:09.658589 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 573/1138] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:10:09.807209 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1e0d9e26-bc98-4f17-b030-1e2941978621 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:09.814708 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1e0d9e26-bc98-4f17-b030-1e2941978621 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1267 microversion: 2.1 time: 0.251806 Jul 25 06:10:09.815283 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 566/1139] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:09 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:10.833314 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d84ecc9c-0ba8-4d62-9d45-97b4a5318a7b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:10.834003 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d84ecc9c-0ba8-4d62-9d45-97b4a5318a7b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:10.840491 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d84ecc9c-0ba8-4d62-9d45-97b4a5318a7b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:10.840937 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d84ecc9c-0ba8-4d62-9d45-97b4a5318a7b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:10.841686 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d84ecc9c-0ba8-4d62-9d45-97b4a5318a7b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:10.842116 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d84ecc9c-0ba8-4d62-9d45-97b4a5318a7b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:10.973115 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d84ecc9c-0ba8-4d62-9d45-97b4a5318a7b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:10.980559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d84ecc9c-0ba8-4d62-9d45-97b4a5318a7b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1267 microversion: 2.1 time: 0.151787 Jul 25 06:10:10.981282 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 574/1140] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:10 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:11.998185 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5fe67763-40a4-438d-8527-a83f9aad7f55 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:11.998792 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5fe67763-40a4-438d-8527-a83f9aad7f55 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:12.005263 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5fe67763-40a4-438d-8527-a83f9aad7f55 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:12.005711 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5fe67763-40a4-438d-8527-a83f9aad7f55 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:12.006461 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5fe67763-40a4-438d-8527-a83f9aad7f55 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:12.006891 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5fe67763-40a4-438d-8527-a83f9aad7f55 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:12.140243 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5fe67763-40a4-438d-8527-a83f9aad7f55 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:12.147742 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5fe67763-40a4-438d-8527-a83f9aad7f55 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1267 microversion: 2.1 time: 0.154219 Jul 25 06:10:12.148357 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 567/1141] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:11 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:13.165592 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-84bb5c0c-1919-4452-850e-2d0a07e3f22f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:13.166232 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-84bb5c0c-1919-4452-850e-2d0a07e3f22f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:13.173688 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84bb5c0c-1919-4452-850e-2d0a07e3f22f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:13.174136 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84bb5c0c-1919-4452-850e-2d0a07e3f22f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:13.174901 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84bb5c0c-1919-4452-850e-2d0a07e3f22f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:13.175338 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-84bb5c0c-1919-4452-850e-2d0a07e3f22f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:13.306373 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-84bb5c0c-1919-4452-850e-2d0a07e3f22f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:13.313717 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-84bb5c0c-1919-4452-850e-2d0a07e3f22f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1267 microversion: 2.1 time: 0.152060 Jul 25 06:10:13.314283 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 575/1142] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:13 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:14.330742 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2008dec6-94f6-4c0a-b6f1-4f125c374fdc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:14.331354 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2008dec6-94f6-4c0a-b6f1-4f125c374fdc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:14.337453 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2008dec6-94f6-4c0a-b6f1-4f125c374fdc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:14.337907 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2008dec6-94f6-4c0a-b6f1-4f125c374fdc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:14.338667 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2008dec6-94f6-4c0a-b6f1-4f125c374fdc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:14.339108 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2008dec6-94f6-4c0a-b6f1-4f125c374fdc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:14.467879 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2008dec6-94f6-4c0a-b6f1-4f125c374fdc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:14.475335 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2008dec6-94f6-4c0a-b6f1-4f125c374fdc tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1267 microversion: 2.1 time: 0.148751 Jul 25 06:10:14.475897 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 568/1143] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:14 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:15.492677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-11457722-790e-4ab8-ba43-47bf20a5ea72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:15.493288 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-11457722-790e-4ab8-ba43-47bf20a5ea72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:15.500605 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-11457722-790e-4ab8-ba43-47bf20a5ea72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:15.501055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-11457722-790e-4ab8-ba43-47bf20a5ea72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:15.501827 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-11457722-790e-4ab8-ba43-47bf20a5ea72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:15.502265 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-11457722-790e-4ab8-ba43-47bf20a5ea72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:15.630859 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-11457722-790e-4ab8-ba43-47bf20a5ea72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:15.639137 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-11457722-790e-4ab8-ba43-47bf20a5ea72 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1267 microversion: 2.1 time: 0.150316 Jul 25 06:10:15.639699 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 576/1144] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:15 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:16.656371 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b08ab325-b4f7-4067-8100-d6c25bfaf4a5 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:16.656908 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b08ab325-b4f7-4067-8100-d6c25bfaf4a5 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:16.660371 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:16.661028 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=6 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:16.664523 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b08ab325-b4f7-4067-8100-d6c25bfaf4a5 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:16.664965 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b08ab325-b4f7-4067-8100-d6c25bfaf4a5 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:16.665715 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b08ab325-b4f7-4067-8100-d6c25bfaf4a5 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:16.666228 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b08ab325-b4f7-4067-8100-d6c25bfaf4a5 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:16.799585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b08ab325-b4f7-4067-8100-d6c25bfaf4a5 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:16.807065 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b08ab325-b4f7-4067-8100-d6c25bfaf4a5 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1267 microversion: 2.1 time: 0.155224 Jul 25 06:10:16.807622 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 569/1145] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:16 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:17.824608 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-006a5ac9-88cb-4fed-bf0f-d66eb4cc8009 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:17.825257 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-006a5ac9-88cb-4fed-bf0f-d66eb4cc8009 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:17.827190 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:17.832526 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-006a5ac9-88cb-4fed-bf0f-d66eb4cc8009 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:17.832981 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-006a5ac9-88cb-4fed-bf0f-d66eb4cc8009 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:17.833737 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-006a5ac9-88cb-4fed-bf0f-d66eb4cc8009 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:17.834172 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-006a5ac9-88cb-4fed-bf0f-d66eb4cc8009 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:17.969667 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-006a5ac9-88cb-4fed-bf0f-d66eb4cc8009 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:17.977063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-006a5ac9-88cb-4fed-bf0f-d66eb4cc8009 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1267 microversion: 2.1 time: 0.156339 Jul 25 06:10:17.977627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 577/1146] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:17 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:18.993346 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8c0f2300-b890-4544-80d6-76609c9354e8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:18.993964 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8c0f2300-b890-4544-80d6-76609c9354e8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:19.001007 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8c0f2300-b890-4544-80d6-76609c9354e8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:19.001459 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8c0f2300-b890-4544-80d6-76609c9354e8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:19.002215 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8c0f2300-b890-4544-80d6-76609c9354e8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:19.002650 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8c0f2300-b890-4544-80d6-76609c9354e8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:19.139241 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8c0f2300-b890-4544-80d6-76609c9354e8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:19.146631 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8c0f2300-b890-4544-80d6-76609c9354e8 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1267 microversion: 2.1 time: 0.157180 Jul 25 06:10:19.147188 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 570/1147] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:18 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:20.162872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c155f077-ae4c-41bb-a2e4-ebb0981f119d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:20.163480 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c155f077-ae4c-41bb-a2e4-ebb0981f119d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:20.170121 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c155f077-ae4c-41bb-a2e4-ebb0981f119d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:20.170696 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c155f077-ae4c-41bb-a2e4-ebb0981f119d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:20.171458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c155f077-ae4c-41bb-a2e4-ebb0981f119d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:20.171892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c155f077-ae4c-41bb-a2e4-ebb0981f119d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:20.288140 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-01075b57-8655-4eb8-a901-b52f158dce48 req-cc8f8bae-0385-43be-86b7-af4666c2be22 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "c0bdb7c6-3cf4-4bf6-a67b-3cc406855567", "name": "network-vif-plugged", "status": "completed", "tag": "73cffae0-d1fe-401f-bf00-2a379c708385"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:20.298072 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-01075b57-8655-4eb8-a901-b52f158dce48 req-cc8f8bae-0385-43be-86b7-af4666c2be22 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:20.298723 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-01075b57-8655-4eb8-a901-b52f158dce48 req-cc8f8bae-0385-43be-86b7-af4666c2be22 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:20.306683 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c155f077-ae4c-41bb-a2e4-ebb0981f119d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:20.311063 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-01075b57-8655-4eb8-a901-b52f158dce48 req-cc8f8bae-0385-43be-86b7-af4666c2be22 service nova] Creating event network-vif-plugged:73cffae0-d1fe-401f-bf00-2a379c708385 for instance c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 on hv-cinder-84841 Jul 25 06:10:20.316177 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-01075b57-8655-4eb8-a901-b52f158dce48 req-cc8f8bae-0385-43be-86b7-af4666c2be22 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031898 Jul 25 06:10:20.316699 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c155f077-ae4c-41bb-a2e4-ebb0981f119d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1267 microversion: 2.1 time: 0.157771 Jul 25 06:10:20.316825 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 571/1148] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:10:20.317745 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 578/1149] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:20 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:21.334843 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-9a9359a0-1286-4ab8-95f1-8f0a6369584c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:21.335548 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-9a9359a0-1286-4ab8-95f1-8f0a6369584c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:21.342489 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9a9359a0-1286-4ab8-95f1-8f0a6369584c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:21.342947 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9a9359a0-1286-4ab8-95f1-8f0a6369584c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:21.343707 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9a9359a0-1286-4ab8-95f1-8f0a6369584c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:21.344175 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-9a9359a0-1286-4ab8-95f1-8f0a6369584c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:21.476628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-9a9359a0-1286-4ab8-95f1-8f0a6369584c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:21.484739 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-9a9359a0-1286-4ab8-95f1-8f0a6369584c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1267 microversion: 2.1 time: 0.154562 Jul 25 06:10:21.485311 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 572/1150] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:21 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:10:22.502095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-60959ff3-ea9b-4a9c-a477-9c3e44f46ba9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:22.502700 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-60959ff3-ea9b-4a9c-a477-9c3e44f46ba9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:22.509325 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-60959ff3-ea9b-4a9c-a477-9c3e44f46ba9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:22.509770 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-60959ff3-ea9b-4a9c-a477-9c3e44f46ba9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:22.510585 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-60959ff3-ea9b-4a9c-a477-9c3e44f46ba9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:22.511017 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-60959ff3-ea9b-4a9c-a477-9c3e44f46ba9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:22.645466 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-60959ff3-ea9b-4a9c-a477-9c3e44f46ba9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:22.653315 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-60959ff3-ea9b-4a9c-a477-9c3e44f46ba9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1453 microversion: 2.1 time: 0.155020 Jul 25 06:10:22.653978 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 579/1151] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:22 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:22.670250 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-901f14a6-708f-4ac3-8924-ac7b54b3644e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:22.670853 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-901f14a6-708f-4ac3-8924-ac7b54b3644e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:22.677292 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-901f14a6-708f-4ac3-8924-ac7b54b3644e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:22.677733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-901f14a6-708f-4ac3-8924-ac7b54b3644e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:22.678477 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-901f14a6-708f-4ac3-8924-ac7b54b3644e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:22.678908 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-901f14a6-708f-4ac3-8924-ac7b54b3644e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:22.808789 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-901f14a6-708f-4ac3-8924-ac7b54b3644e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:22.817104 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-901f14a6-708f-4ac3-8924-ac7b54b3644e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1453 microversion: 2.1 time: 0.151332 Jul 25 06:10:22.817670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 573/1152] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:22 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:24.950602 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-b7ed2208-5419-4184-a821-349ec23e7732 req-81d2f74e-7da7-4f87-865f-9e775943a344 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "c0bdb7c6-3cf4-4bf6-a67b-3cc406855567", "tag": "73cffae0-d1fe-401f-bf00-2a379c708385"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:24.958929 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-b7ed2208-5419-4184-a821-349ec23e7732 req-81d2f74e-7da7-4f87-865f-9e775943a344 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:24.959367 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-b7ed2208-5419-4184-a821-349ec23e7732 req-81d2f74e-7da7-4f87-865f-9e775943a344 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:24.970934 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-b7ed2208-5419-4184-a821-349ec23e7732 req-81d2f74e-7da7-4f87-865f-9e775943a344 service nova] Creating event network-changed:73cffae0-d1fe-401f-bf00-2a379c708385 for instance c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 on hv-cinder-84841 Jul 25 06:10:24.975845 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-b7ed2208-5419-4184-a821-349ec23e7732 req-81d2f74e-7da7-4f87-865f-9e775943a344 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091685 Jul 25 06:10:24.976458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 580/1153] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:10:29.381839 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-fc45d1b8-a3ec-409c-a445-2a420f06ce7c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Action: 'action', calling method: <bound method ShelveController._shelve of <nova.api.openstack.compute.shelve.ShelveController object at 0x7f6533edea90>>, body: {"shelve": {}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:29.384412 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-fc45d1b8-a3ec-409c-a445-2a420f06ce7c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:29.389262 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fc45d1b8-a3ec-409c-a445-2a420f06ce7c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:29.389706 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fc45d1b8-a3ec-409c-a445-2a420f06ce7c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:29.390469 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fc45d1b8-a3ec-409c-a445-2a420f06ce7c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:29.390895 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-fc45d1b8-a3ec-409c-a445-2a420f06ce7c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:29.413119 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.objects.instance [None req-fc45d1b8-a3ec-409c-a445-2a420f06ce7c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lazy-loading 'flavor' on Instance uuid 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b {{(pid=124917) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:10:29.645756 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-fc45d1b8-a3ec-409c-a445-2a420f06ce7c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "POST /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b/action" status: 202 len: 0 microversion: 2.1 time: 0.267628 Jul 25 06:10:29.646259 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 574/1154] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:10:29 2022] POST /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:10:29.656773 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-137d6cac-9bb6-45ca-bde9-6191b2634362 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:29.657507 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-137d6cac-9bb6-45ca-bde9-6191b2634362 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:29.664671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-137d6cac-9bb6-45ca-bde9-6191b2634362 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:29.664671 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-137d6cac-9bb6-45ca-bde9-6191b2634362 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:29.665439 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-137d6cac-9bb6-45ca-bde9-6191b2634362 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:29.665865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-137d6cac-9bb6-45ca-bde9-6191b2634362 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:29.804323 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-137d6cac-9bb6-45ca-bde9-6191b2634362 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:29.812185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-137d6cac-9bb6-45ca-bde9-6191b2634362 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.160843 Jul 25 06:10:29.812744 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 581/1155] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:29 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:30.830569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-53257f31-1f46-4e1d-9e6c-b7ca6c758e1d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:30.831282 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-53257f31-1f46-4e1d-9e6c-b7ca6c758e1d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:30.837444 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-53257f31-1f46-4e1d-9e6c-b7ca6c758e1d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:30.837886 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-53257f31-1f46-4e1d-9e6c-b7ca6c758e1d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:30.838632 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-53257f31-1f46-4e1d-9e6c-b7ca6c758e1d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:30.839068 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-53257f31-1f46-4e1d-9e6c-b7ca6c758e1d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:30.843449 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:30.975365 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-53257f31-1f46-4e1d-9e6c-b7ca6c758e1d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:30.983450 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-53257f31-1f46-4e1d-9e6c-b7ca6c758e1d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.157626 Jul 25 06:10:30.984020 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 575/1156] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:30 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:32.001045 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-49f2a84d-2421-4899-8a38-2e5f70327ad2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:32.001651 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-49f2a84d-2421-4899-8a38-2e5f70327ad2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:32.004073 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=31 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:32.008791 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49f2a84d-2421-4899-8a38-2e5f70327ad2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:32.009236 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49f2a84d-2421-4899-8a38-2e5f70327ad2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:32.009998 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49f2a84d-2421-4899-8a38-2e5f70327ad2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:32.010428 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49f2a84d-2421-4899-8a38-2e5f70327ad2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:32.013647 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=63 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:32.142206 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-49f2a84d-2421-4899-8a38-2e5f70327ad2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:32.150062 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-49f2a84d-2421-4899-8a38-2e5f70327ad2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.153360 Jul 25 06:10:32.150744 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 582/1157] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:31 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:33.167074 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b9ad997b-ab22-41b9-873d-387a15e63a00 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:33.167701 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b9ad997b-ab22-41b9-873d-387a15e63a00 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:33.170708 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:33.175382 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9ad997b-ab22-41b9-873d-387a15e63a00 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:33.175821 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9ad997b-ab22-41b9-873d-387a15e63a00 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:33.176665 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9ad997b-ab22-41b9-873d-387a15e63a00 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:33.177095 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9ad997b-ab22-41b9-873d-387a15e63a00 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:33.306331 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b9ad997b-ab22-41b9-873d-387a15e63a00 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:33.314556 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b9ad997b-ab22-41b9-873d-387a15e63a00 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.151422 Jul 25 06:10:33.315114 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 576/1158] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:33 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:34.331966 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-54764c29-3392-409b-ae8b-e870e107e942 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:34.332643 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-54764c29-3392-409b-ae8b-e870e107e942 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:34.339060 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-54764c29-3392-409b-ae8b-e870e107e942 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:34.339514 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-54764c29-3392-409b-ae8b-e870e107e942 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:34.340802 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-54764c29-3392-409b-ae8b-e870e107e942 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:34.341328 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-54764c29-3392-409b-ae8b-e870e107e942 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:34.476809 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-54764c29-3392-409b-ae8b-e870e107e942 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:34.484768 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-54764c29-3392-409b-ae8b-e870e107e942 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.156885 Jul 25 06:10:34.485332 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 583/1159] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:34 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:35.504091 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b9b1c697-beea-4ed9-92ec-f5d2a4f5275e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:35.504725 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b9b1c697-beea-4ed9-92ec-f5d2a4f5275e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:35.511231 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9b1c697-beea-4ed9-92ec-f5d2a4f5275e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:35.511681 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9b1c697-beea-4ed9-92ec-f5d2a4f5275e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:35.513393 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9b1c697-beea-4ed9-92ec-f5d2a4f5275e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:35.513393 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9b1c697-beea-4ed9-92ec-f5d2a4f5275e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:35.655634 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b9b1c697-beea-4ed9-92ec-f5d2a4f5275e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:35.663787 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b9b1c697-beea-4ed9-92ec-f5d2a4f5275e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.164894 Jul 25 06:10:35.664400 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 577/1160] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:35 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:36.681632 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d0671549-b714-4b22-a05f-319b4bdf004d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:36.682305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d0671549-b714-4b22-a05f-319b4bdf004d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:36.689661 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d0671549-b714-4b22-a05f-319b4bdf004d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:36.690110 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d0671549-b714-4b22-a05f-319b4bdf004d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:36.690870 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d0671549-b714-4b22-a05f-319b4bdf004d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:36.691305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d0671549-b714-4b22-a05f-319b4bdf004d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:36.820573 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d0671549-b714-4b22-a05f-319b4bdf004d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:36.828001 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d0671549-b714-4b22-a05f-319b4bdf004d tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.150403 Jul 25 06:10:36.828601 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 584/1161] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:36 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:37.844227 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-cf42a9c2-d374-40a3-a8b7-9d91e2f643bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:37.844835 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-cf42a9c2-d374-40a3-a8b7-9d91e2f643bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:37.851220 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf42a9c2-d374-40a3-a8b7-9d91e2f643bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:37.851660 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf42a9c2-d374-40a3-a8b7-9d91e2f643bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:37.852438 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf42a9c2-d374-40a3-a8b7-9d91e2f643bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:37.852865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-cf42a9c2-d374-40a3-a8b7-9d91e2f643bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:37.987906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-cf42a9c2-d374-40a3-a8b7-9d91e2f643bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:37.995337 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-cf42a9c2-d374-40a3-a8b7-9d91e2f643bd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.155056 Jul 25 06:10:37.995896 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 578/1162] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:37 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:39.012528 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1fd6453a-6d99-40c7-97da-f5b7309e2d49 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:39.013142 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1fd6453a-6d99-40c7-97da-f5b7309e2d49 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:39.019729 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1fd6453a-6d99-40c7-97da-f5b7309e2d49 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:39.020134 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1fd6453a-6d99-40c7-97da-f5b7309e2d49 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:39.020905 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1fd6453a-6d99-40c7-97da-f5b7309e2d49 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:39.021343 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1fd6453a-6d99-40c7-97da-f5b7309e2d49 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:39.149942 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1fd6453a-6d99-40c7-97da-f5b7309e2d49 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:39.157773 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1fd6453a-6d99-40c7-97da-f5b7309e2d49 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.149103 Jul 25 06:10:39.158331 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 585/1163] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:39 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:10:40.175267 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-76da2626-77fe-4531-a0bb-a205dd6908a7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:40.175881 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-76da2626-77fe-4531-a0bb-a205dd6908a7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:40.182495 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-76da2626-77fe-4531-a0bb-a205dd6908a7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:40.182939 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-76da2626-77fe-4531-a0bb-a205dd6908a7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:40.183693 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-76da2626-77fe-4531-a0bb-a205dd6908a7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:40.184237 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-76da2626-77fe-4531-a0bb-a205dd6908a7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:40.316359 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-76da2626-77fe-4531-a0bb-a205dd6908a7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:40.323797 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-76da2626-77fe-4531-a0bb-a205dd6908a7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.152439 Jul 25 06:10:40.324408 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 579/1164] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:40 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:41.340944 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c5a2dc3f-deba-4e6a-85ae-15cf44eed5e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:41.341554 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c5a2dc3f-deba-4e6a-85ae-15cf44eed5e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:41.348139 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc3f-deba-4e6a-85ae-15cf44eed5e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:41.348595 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc3f-deba-4e6a-85ae-15cf44eed5e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:41.349351 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc3f-deba-4e6a-85ae-15cf44eed5e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:41.349782 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc3f-deba-4e6a-85ae-15cf44eed5e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:41.481422 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c5a2dc3f-deba-4e6a-85ae-15cf44eed5e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:41.488936 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c5a2dc3f-deba-4e6a-85ae-15cf44eed5e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.151892 Jul 25 06:10:41.489501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 586/1165] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:41 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:42.506307 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-3642d4a7-121c-43a2-b6ee-778df7beafd2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:42.506966 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-3642d4a7-121c-43a2-b6ee-778df7beafd2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:42.514147 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3642d4a7-121c-43a2-b6ee-778df7beafd2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:42.514600 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3642d4a7-121c-43a2-b6ee-778df7beafd2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:42.515358 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3642d4a7-121c-43a2-b6ee-778df7beafd2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:42.515823 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-3642d4a7-121c-43a2-b6ee-778df7beafd2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:42.650655 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-3642d4a7-121c-43a2-b6ee-778df7beafd2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:42.658488 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-3642d4a7-121c-43a2-b6ee-778df7beafd2 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.156030 Jul 25 06:10:42.659238 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 580/1166] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:42 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:43.676971 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-58276f88-e26e-4bed-80ce-dcab15633960 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:43.677593 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-58276f88-e26e-4bed-80ce-dcab15633960 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:43.684891 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-58276f88-e26e-4bed-80ce-dcab15633960 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:43.685513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-58276f88-e26e-4bed-80ce-dcab15633960 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:43.686231 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-58276f88-e26e-4bed-80ce-dcab15633960 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:43.686665 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-58276f88-e26e-4bed-80ce-dcab15633960 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:43.827572 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-58276f88-e26e-4bed-80ce-dcab15633960 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:43.835513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-58276f88-e26e-4bed-80ce-dcab15633960 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1512 microversion: 2.1 time: 0.162615 Jul 25 06:10:43.836175 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 587/1167] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:43 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:43.852367 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-26e7aaea-8dbc-4503-a877-7d984fd54430 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Action: 'action', calling method: <bound method ShelveController._unshelve of <nova.api.openstack.compute.shelve.ShelveController object at 0x7f6533edea90>>, body: {"unshelve": null} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:43.852935 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-26e7aaea-8dbc-4503-a877-7d984fd54430 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:43.860130 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26e7aaea-8dbc-4503-a877-7d984fd54430 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:43.860583 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26e7aaea-8dbc-4503-a877-7d984fd54430 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:43.861480 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26e7aaea-8dbc-4503-a877-7d984fd54430 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:43.861840 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-26e7aaea-8dbc-4503-a877-7d984fd54430 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:44.053206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-26e7aaea-8dbc-4503-a877-7d984fd54430 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "POST /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b/action" status: 202 len: 0 microversion: 2.1 time: 0.204625 Jul 25 06:10:44.053731 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 581/1168] 10.222.0.40 () {60 vars in 1277 bytes} [Mon Jul 25 06:10:43 2022] POST /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:10:44.062336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-71a87a37-66a5-4827-853a-1b8855a9dbf3 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:44.062948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-71a87a37-66a5-4827-853a-1b8855a9dbf3 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:44.069080 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-71a87a37-66a5-4827-853a-1b8855a9dbf3 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:44.073936 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-71a87a37-66a5-4827-853a-1b8855a9dbf3 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:44.073936 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-71a87a37-66a5-4827-853a-1b8855a9dbf3 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:44.073936 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-71a87a37-66a5-4827-853a-1b8855a9dbf3 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:44.241878 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-71a87a37-66a5-4827-853a-1b8855a9dbf3 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:44.249781 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-71a87a37-66a5-4827-853a-1b8855a9dbf3 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1520 microversion: 2.1 time: 0.191837 Jul 25 06:10:44.250377 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 588/1169] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:44 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:45.268180 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-a21d5154-b1c1-478c-9c6e-1424417910e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:45.268804 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-a21d5154-b1c1-478c-9c6e-1424417910e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:45.275422 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a21d5154-b1c1-478c-9c6e-1424417910e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:45.275865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a21d5154-b1c1-478c-9c6e-1424417910e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:45.276653 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a21d5154-b1c1-478c-9c6e-1424417910e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:45.277080 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-a21d5154-b1c1-478c-9c6e-1424417910e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:45.409941 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-a21d5154-b1c1-478c-9c6e-1424417910e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:45.417442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-a21d5154-b1c1-478c-9c6e-1424417910e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1520 microversion: 2.1 time: 0.153750 Jul 25 06:10:45.418677 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 582/1170] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:45 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:10:46.296883 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-7595038f-ad26-40e6-b7da-b896d7b39695 req-ab6afa26-8503-4f18-943e-c6b41bb08dd7 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b", "name": "network-vif-unplugged", "status": "completed", "tag": "58a00c23-3e4e-4b24-9a79-d8fb739d245a"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:10:46.304985 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-7595038f-ad26-40e6-b7da-b896d7b39695 req-ab6afa26-8503-4f18-943e-c6b41bb08dd7 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:46.305432 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-7595038f-ad26-40e6-b7da-b896d7b39695 req-ab6afa26-8503-4f18-943e-c6b41bb08dd7 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:46.317114 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.compute.server_external_events [req-7595038f-ad26-40e6-b7da-b896d7b39695 req-ab6afa26-8503-4f18-943e-c6b41bb08dd7 service nova] Unable to find a host for instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b. Dropping event network-vif-unplugged {{(pid=124918) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 06:10:46.322063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-7595038f-ad26-40e6-b7da-b896d7b39695 req-ab6afa26-8503-4f18-943e-c6b41bb08dd7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.078109 Jul 25 06:10:46.322063 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 589/1171] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 79 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 06:10:46.435416 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2fa24f07-e5b1-4bf9-afc7-5a0e80cb8ce7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:46.436082 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2fa24f07-e5b1-4bf9-afc7-5a0e80cb8ce7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:46.442738 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2fa24f07-e5b1-4bf9-afc7-5a0e80cb8ce7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:46.448065 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2fa24f07-e5b1-4bf9-afc7-5a0e80cb8ce7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:46.448065 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2fa24f07-e5b1-4bf9-afc7-5a0e80cb8ce7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:46.448065 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2fa24f07-e5b1-4bf9-afc7-5a0e80cb8ce7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:46.576707 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2fa24f07-e5b1-4bf9-afc7-5a0e80cb8ce7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:46.584324 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2fa24f07-e5b1-4bf9-afc7-5a0e80cb8ce7 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1520 microversion: 2.1 time: 0.153436 Jul 25 06:10:46.584893 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 583/1172] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:46 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:47.600796 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ca4c53cd-a959-48b0-94c5-8facd7ce766c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:47.601427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ca4c53cd-a959-48b0-94c5-8facd7ce766c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:47.608739 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ca4c53cd-a959-48b0-94c5-8facd7ce766c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:47.609131 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ca4c53cd-a959-48b0-94c5-8facd7ce766c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:47.609887 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ca4c53cd-a959-48b0-94c5-8facd7ce766c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:47.610320 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ca4c53cd-a959-48b0-94c5-8facd7ce766c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:47.741774 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ca4c53cd-a959-48b0-94c5-8facd7ce766c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:47.749751 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ca4c53cd-a959-48b0-94c5-8facd7ce766c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1520 microversion: 2.1 time: 0.153020 Jul 25 06:10:47.750327 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 590/1173] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:47 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:48.766067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d153d6d0-0c03-43c7-a9c9-2c94fd6b76cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:48.766682 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d153d6d0-0c03-43c7-a9c9-2c94fd6b76cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:48.773229 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d153d6d0-0c03-43c7-a9c9-2c94fd6b76cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:48.773925 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d153d6d0-0c03-43c7-a9c9-2c94fd6b76cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:48.774678 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d153d6d0-0c03-43c7-a9c9-2c94fd6b76cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:48.775113 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d153d6d0-0c03-43c7-a9c9-2c94fd6b76cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:48.909658 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d153d6d0-0c03-43c7-a9c9-2c94fd6b76cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:48.917268 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d153d6d0-0c03-43c7-a9c9-2c94fd6b76cd tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1520 microversion: 2.1 time: 0.155156 Jul 25 06:10:48.918364 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 584/1174] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:48 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:49.935094 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-663f4bcd-9af5-42d3-b8b9-661502f76192 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:49.935707 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-663f4bcd-9af5-42d3-b8b9-661502f76192 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:49.942210 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-663f4bcd-9af5-42d3-b8b9-661502f76192 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:49.942832 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-663f4bcd-9af5-42d3-b8b9-661502f76192 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:49.943597 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-663f4bcd-9af5-42d3-b8b9-661502f76192 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:49.944034 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-663f4bcd-9af5-42d3-b8b9-661502f76192 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:50.081246 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-663f4bcd-9af5-42d3-b8b9-661502f76192 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:50.088913 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-663f4bcd-9af5-42d3-b8b9-661502f76192 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1522 microversion: 2.1 time: 0.157983 Jul 25 06:10:50.089532 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 591/1175] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:49 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:51.107360 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0ad3102f-c70e-432d-8776-f8e0a209ac18 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:51.107923 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0ad3102f-c70e-432d-8776-f8e0a209ac18 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:51.114644 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ad3102f-c70e-432d-8776-f8e0a209ac18 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:51.115096 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ad3102f-c70e-432d-8776-f8e0a209ac18 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:51.115861 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ad3102f-c70e-432d-8776-f8e0a209ac18 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:51.116351 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0ad3102f-c70e-432d-8776-f8e0a209ac18 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:51.255754 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-0ad3102f-c70e-432d-8776-f8e0a209ac18 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:51.263733 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0ad3102f-c70e-432d-8776-f8e0a209ac18 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1578 microversion: 2.1 time: 0.161127 Jul 25 06:10:51.264323 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 585/1176] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:51 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:52.280421 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-daedb13f-2599-47e7-86b3-de386089ca16 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:52.281032 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-daedb13f-2599-47e7-86b3-de386089ca16 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:52.287580 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-daedb13f-2599-47e7-86b3-de386089ca16 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:52.288017 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-daedb13f-2599-47e7-86b3-de386089ca16 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:52.288791 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-daedb13f-2599-47e7-86b3-de386089ca16 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:52.289221 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-daedb13f-2599-47e7-86b3-de386089ca16 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:52.417941 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-daedb13f-2599-47e7-86b3-de386089ca16 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:52.425955 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-daedb13f-2599-47e7-86b3-de386089ca16 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1578 microversion: 2.1 time: 0.149548 Jul 25 06:10:52.426524 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 592/1177] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:52 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:53.444024 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-f819531c-449b-4652-94e7-8ecef7f607bc tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:53.444677 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-f819531c-449b-4652-94e7-8ecef7f607bc tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:53.451811 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f819531c-449b-4652-94e7-8ecef7f607bc tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:53.452294 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f819531c-449b-4652-94e7-8ecef7f607bc tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:53.453049 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f819531c-449b-4652-94e7-8ecef7f607bc tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:53.453479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-f819531c-449b-4652-94e7-8ecef7f607bc tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:53.589054 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-f819531c-449b-4652-94e7-8ecef7f607bc tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:53.597496 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-f819531c-449b-4652-94e7-8ecef7f607bc tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1578 microversion: 2.1 time: 0.157368 Jul 25 06:10:53.598194 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 586/1178] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:53 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:54.614720 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-cb85aa01-7ab9-4d82-8610-3672bdefe2d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:54.615363 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-cb85aa01-7ab9-4d82-8610-3672bdefe2d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:54.622054 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cb85aa01-7ab9-4d82-8610-3672bdefe2d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:54.622501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cb85aa01-7ab9-4d82-8610-3672bdefe2d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:54.623270 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cb85aa01-7ab9-4d82-8610-3672bdefe2d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:54.623717 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cb85aa01-7ab9-4d82-8610-3672bdefe2d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:54.755768 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cb85aa01-7ab9-4d82-8610-3672bdefe2d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:54.763864 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-cb85aa01-7ab9-4d82-8610-3672bdefe2d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1578 microversion: 2.1 time: 0.153019 Jul 25 06:10:54.764461 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 593/1179] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:54 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:55.781751 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-d9148d12-b1ab-45b0-8f3f-1d3377947742 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:55.782370 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-d9148d12-b1ab-45b0-8f3f-1d3377947742 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:55.789118 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d9148d12-b1ab-45b0-8f3f-1d3377947742 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:55.789570 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d9148d12-b1ab-45b0-8f3f-1d3377947742 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:55.790333 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d9148d12-b1ab-45b0-8f3f-1d3377947742 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:55.790770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-d9148d12-b1ab-45b0-8f3f-1d3377947742 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:55.919480 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-d9148d12-b1ab-45b0-8f3f-1d3377947742 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:55.926907 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-d9148d12-b1ab-45b0-8f3f-1d3377947742 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1578 microversion: 2.1 time: 0.149530 Jul 25 06:10:55.927482 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 587/1180] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:55 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:56.944072 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-c9851b6f-cdfa-46e2-89a9-ab246e9be9d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:56.944704 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-c9851b6f-cdfa-46e2-89a9-ab246e9be9d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:56.951238 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9851b6f-cdfa-46e2-89a9-ab246e9be9d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:56.951677 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9851b6f-cdfa-46e2-89a9-ab246e9be9d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:56.952457 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9851b6f-cdfa-46e2-89a9-ab246e9be9d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:56.952889 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-c9851b6f-cdfa-46e2-89a9-ab246e9be9d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:57.083233 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-c9851b6f-cdfa-46e2-89a9-ab246e9be9d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:57.091499 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-c9851b6f-cdfa-46e2-89a9-ab246e9be9d0 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1578 microversion: 2.1 time: 0.151317 Jul 25 06:10:57.092055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 594/1181] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:56 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:58.108827 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8af178e4-5640-4371-955f-b77b09e80c34 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:58.109360 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8af178e4-5640-4371-955f-b77b09e80c34 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:58.115825 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8af178e4-5640-4371-955f-b77b09e80c34 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:58.116304 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8af178e4-5640-4371-955f-b77b09e80c34 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:58.117055 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8af178e4-5640-4371-955f-b77b09e80c34 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:58.117585 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8af178e4-5640-4371-955f-b77b09e80c34 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:58.252083 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8af178e4-5640-4371-955f-b77b09e80c34 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:58.262770 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8af178e4-5640-4371-955f-b77b09e80c34 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1578 microversion: 2.1 time: 0.157731 Jul 25 06:10:58.263489 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 588/1182] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:58 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:10:59.279535 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-06673147-2fc6-4e3d-9bc1-6bf8b9e44afa tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:10:59.280173 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-06673147-2fc6-4e3d-9bc1-6bf8b9e44afa tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:10:59.286788 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06673147-2fc6-4e3d-9bc1-6bf8b9e44afa tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:59.287238 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06673147-2fc6-4e3d-9bc1-6bf8b9e44afa tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:59.288000 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06673147-2fc6-4e3d-9bc1-6bf8b9e44afa tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:10:59.288532 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-06673147-2fc6-4e3d-9bc1-6bf8b9e44afa tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:10:59.426324 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-06673147-2fc6-4e3d-9bc1-6bf8b9e44afa tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:10:59.433772 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-06673147-2fc6-4e3d-9bc1-6bf8b9e44afa tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1578 microversion: 2.1 time: 0.158241 Jul 25 06:10:59.435114 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 595/1183] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:10:59 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:11:00.306278 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-2c7abfb1-1c6b-472b-b4d0-06c9cf8c974e req-74807dad-020d-4eab-839b-e64c68a1f5a4 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b", "name": "network-vif-plugged", "status": "completed", "tag": "58a00c23-3e4e-4b24-9a79-d8fb739d245a"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:11:00.315569 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-2c7abfb1-1c6b-472b-b4d0-06c9cf8c974e req-74807dad-020d-4eab-839b-e64c68a1f5a4 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:11:00.316017 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-2c7abfb1-1c6b-472b-b4d0-06c9cf8c974e req-74807dad-020d-4eab-839b-e64c68a1f5a4 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:11:00.327806 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-2c7abfb1-1c6b-472b-b4d0-06c9cf8c974e req-74807dad-020d-4eab-839b-e64c68a1f5a4 service nova] Creating event network-vif-plugged:58a00c23-3e4e-4b24-9a79-d8fb739d245a for instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b on hv-cinder-84841 Jul 25 06:11:00.333033 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-2c7abfb1-1c6b-472b-b4d0-06c9cf8c974e req-74807dad-020d-4eab-839b-e64c68a1f5a4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030488 Jul 25 06:11:00.333619 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 589/1184] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:11:00.451862 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3205cb52-d870-494c-9713-458e242e12e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:11:00.452511 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3205cb52-d870-494c-9713-458e242e12e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:11:00.459237 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3205cb52-d870-494c-9713-458e242e12e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:11:00.459679 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3205cb52-d870-494c-9713-458e242e12e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:11:00.460458 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3205cb52-d870-494c-9713-458e242e12e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:11:00.460892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3205cb52-d870-494c-9713-458e242e12e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:11:00.598159 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3205cb52-d870-494c-9713-458e242e12e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:11:00.606476 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3205cb52-d870-494c-9713-458e242e12e4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1578 microversion: 2.1 time: 0.158687 Jul 25 06:11:00.607055 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 596/1185] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:11:00 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:11:01.623865 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-00d87463-a0f8-49cf-8e69-010d7fdf822c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:11:01.624744 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-00d87463-a0f8-49cf-8e69-010d7fdf822c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:11:01.630991 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-00d87463-a0f8-49cf-8e69-010d7fdf822c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:11:01.631442 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-00d87463-a0f8-49cf-8e69-010d7fdf822c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:11:01.632236 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-00d87463-a0f8-49cf-8e69-010d7fdf822c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:11:01.632675 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-00d87463-a0f8-49cf-8e69-010d7fdf822c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:11:01.636669 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:01.772496 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-00d87463-a0f8-49cf-8e69-010d7fdf822c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:11:01.780466 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-00d87463-a0f8-49cf-8e69-010d7fdf822c tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1578 microversion: 2.1 time: 0.161407 Jul 25 06:11:01.781052 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 590/1186] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:11:01 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:11:02.798302 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-cc108568-adea-4366-bba2-261247f1eb09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:11:02.798846 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-cc108568-adea-4366-bba2-261247f1eb09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:11:02.801275 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=30 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:02.805965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cc108568-adea-4366-bba2-261247f1eb09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:11:02.806403 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cc108568-adea-4366-bba2-261247f1eb09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:11:02.807147 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cc108568-adea-4366-bba2-261247f1eb09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:11:02.807573 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-cc108568-adea-4366-bba2-261247f1eb09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:11:02.812189 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=86 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:02.943427 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-cc108568-adea-4366-bba2-261247f1eb09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:11:02.952221 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-cc108568-adea-4366-bba2-261247f1eb09 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1565 microversion: 2.1 time: 0.158595 Jul 25 06:11:02.952806 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 597/1187] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:11:02 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:11:27.376208 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:11:27.376714 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Mon Jul 25 06:11:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:12:04.775268 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=31 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:04.776178 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=5 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:04.780325 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Action: 'create', calling method: <bound method ServersController.create of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f5d4f0>>, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1451896078", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1193999269", "security_groups": [{"name": "tempest-secgroup-smoke-1525845504"}], "block_device_mapping_v2": [{"uuid": "cd07d848-8a27-4856-9e55-9f7da5f9efb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "61120c55-35c0-41eb-8aba-884eee11abab"}]}} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:12:04.888758 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.network.neutron [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] validate_networks() for [('61120c55-35c0-41eb-8aba-884eee11abab', None, None, None, None, None)] {{(pid=124917) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 06:12:05.293875 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Flavor limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 06:12:05.294297 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Image limits 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 06:12:05.294763 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Flavor pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 06:12:05.295164 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Image pref 0:0:0 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 06:12:05.295568 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.virt.hardware [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124917) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 06:12:05.304292 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:05.304729 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:05.305508 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:05.305936 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:05.322205 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Getting quotas for project d275686dbcfc44769065d5d9ba1a6f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 06:12:05.326060 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.quota [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Getting quotas for user 86335999e9744e4c815a628607618b4f and project d275686dbcfc44769065d5d9ba1a6f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=124917) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 06:12:05.381741 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Going to run 1 instances... {{(pid=124917) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 06:12:05.383940 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] block_device_mapping [BlockDeviceMapping(attachment_id=<?>,boot_index=0,connection_info=None,created_at=<?>,delete_on_termination=False,deleted=<?>,deleted_at=<?>,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=<?>,image_id=None,instance=<?>,instance_uuid=<?>,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=<?>,uuid=<?>,volume_id='cd07d848-8a27-4856-9e55-9f7da5f9efb3',volume_size=None,volume_type=None)] {{(pid=124917) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 06:12:05.784462 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8497c998-5d6f-42d4-9b3a-9cf02d4d2526 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.010706 Jul 25 06:12:05.785157 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 591/1188] 10.222.0.40 () {60 vars in 1146 bytes} [Mon Jul 25 06:12:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 06:12:05.792848 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:05.793591 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=5 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:05.852134 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-85c29259-d695-45f0-8262-02c96142fdc0 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:05.852784 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-85c29259-d695-45f0-8262-02c96142fdc0 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:05.907393 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-85c29259-d695-45f0-8262-02c96142fdc0 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:05.914218 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-85c29259-d695-45f0-8262-02c96142fdc0 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1095 microversion: 2.1 time: 0.123069 Jul 25 06:12:05.914762 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 598/1189] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:05 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1095 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:06.931995 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-c828dd63-cd78-443c-8f5f-49602598fb04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:06.932648 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-c828dd63-cd78-443c-8f5f-49602598fb04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:06.940046 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c828dd63-cd78-443c-8f5f-49602598fb04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:06.941931 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c828dd63-cd78-443c-8f5f-49602598fb04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:06.941931 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c828dd63-cd78-443c-8f5f-49602598fb04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:06.941931 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-c828dd63-cd78-443c-8f5f-49602598fb04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:07.005153 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-c828dd63-cd78-443c-8f5f-49602598fb04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:07.012924 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-c828dd63-cd78-443c-8f5f-49602598fb04 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1145 microversion: 2.1 time: 0.085447 Jul 25 06:12:07.013689 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 592/1190] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:06 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:08.030267 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1fca3dee-d14b-4fdb-8889-09b22420ac8d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:08.030839 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-1fca3dee-d14b-4fdb-8889-09b22420ac8d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:08.038818 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1fca3dee-d14b-4fdb-8889-09b22420ac8d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:08.039271 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1fca3dee-d14b-4fdb-8889-09b22420ac8d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:08.040048 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1fca3dee-d14b-4fdb-8889-09b22420ac8d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:08.040513 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-1fca3dee-d14b-4fdb-8889-09b22420ac8d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:08.103277 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-1fca3dee-d14b-4fdb-8889-09b22420ac8d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:08.110743 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1fca3dee-d14b-4fdb-8889-09b22420ac8d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1211 microversion: 2.1 time: 0.084441 Jul 25 06:12:08.111319 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 599/1191] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:08 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:09.127175 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-6bdf8409-12e1-4260-a9db-20b5f4896115 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:09.134403 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-6bdf8409-12e1-4260-a9db-20b5f4896115 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:09.135366 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6bdf8409-12e1-4260-a9db-20b5f4896115 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:09.135813 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6bdf8409-12e1-4260-a9db-20b5f4896115 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:09.136593 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6bdf8409-12e1-4260-a9db-20b5f4896115 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:09.137021 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-6bdf8409-12e1-4260-a9db-20b5f4896115 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:09.338963 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-6bdf8409-12e1-4260-a9db-20b5f4896115 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:09.353216 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-6bdf8409-12e1-4260-a9db-20b5f4896115 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1267 microversion: 2.1 time: 0.227997 Jul 25 06:12:09.363265 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 593/1192] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:09 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:09.376322 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-333d50ac-b769-4680-9f0b-d0d04aaf5b1b req-f9e7bd9d-21da-4d6e-aa94-f2432d24576b service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "665b20d0-f0bc-4e21-9003-055d987a93ca", "tag": "1bd4b51c-54f5-4c0f-9d56-7ac19d08837f"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:12:09.384922 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-333d50ac-b769-4680-9f0b-d0d04aaf5b1b req-f9e7bd9d-21da-4d6e-aa94-f2432d24576b service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:09.385390 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-333d50ac-b769-4680-9f0b-d0d04aaf5b1b req-f9e7bd9d-21da-4d6e-aa94-f2432d24576b service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:09.397085 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-333d50ac-b769-4680-9f0b-d0d04aaf5b1b req-f9e7bd9d-21da-4d6e-aa94-f2432d24576b service nova] Creating event network-changed:1bd4b51c-54f5-4c0f-9d56-7ac19d08837f for instance 665b20d0-f0bc-4e21-9003-055d987a93ca on hv-cinder-84841 Jul 25 06:12:09.402695 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-333d50ac-b769-4680-9f0b-d0d04aaf5b1b req-f9e7bd9d-21da-4d6e-aa94-f2432d24576b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101300 Jul 25 06:12:09.403243 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 600/1193] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:12:10.370189 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-24039f70-58f9-4664-a88f-7b6a6adbaa5e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:10.370805 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-24039f70-58f9-4664-a88f-7b6a6adbaa5e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:10.377420 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-24039f70-58f9-4664-a88f-7b6a6adbaa5e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:10.378574 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-24039f70-58f9-4664-a88f-7b6a6adbaa5e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:10.379280 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-24039f70-58f9-4664-a88f-7b6a6adbaa5e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:10.379717 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-24039f70-58f9-4664-a88f-7b6a6adbaa5e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:10.597628 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-24039f70-58f9-4664-a88f-7b6a6adbaa5e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:10.605317 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-24039f70-58f9-4664-a88f-7b6a6adbaa5e tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1267 microversion: 2.1 time: 0.239115 Jul 25 06:12:10.605888 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 594/1194] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:10 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:11.623740 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-4500c9fb-815d-41c5-9bdd-9195564b0f92 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:11.624464 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-4500c9fb-815d-41c5-9bdd-9195564b0f92 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:11.631537 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4500c9fb-815d-41c5-9bdd-9195564b0f92 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:11.633210 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4500c9fb-815d-41c5-9bdd-9195564b0f92 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:11.633210 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4500c9fb-815d-41c5-9bdd-9195564b0f92 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:11.633419 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-4500c9fb-815d-41c5-9bdd-9195564b0f92 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:11.764832 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-4500c9fb-815d-41c5-9bdd-9195564b0f92 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:11.773082 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-4500c9fb-815d-41c5-9bdd-9195564b0f92 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1267 microversion: 2.1 time: 0.153974 Jul 25 06:12:11.773641 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 601/1195] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:11 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:12.789859 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-596c72d7-c13a-47f1-b6c0-009781277589 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:12.790474 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-596c72d7-c13a-47f1-b6c0-009781277589 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:12.796946 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-596c72d7-c13a-47f1-b6c0-009781277589 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:12.797391 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-596c72d7-c13a-47f1-b6c0-009781277589 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:12.798128 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-596c72d7-c13a-47f1-b6c0-009781277589 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:12.798558 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-596c72d7-c13a-47f1-b6c0-009781277589 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:12.932309 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-596c72d7-c13a-47f1-b6c0-009781277589 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:12.939651 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-596c72d7-c13a-47f1-b6c0-009781277589 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1267 microversion: 2.1 time: 0.153666 Jul 25 06:12:12.940238 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 595/1196] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:12 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:13.957449 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-9b8c5608-b0ad-4c05-9dec-a53b072ef74c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:13.958084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-9b8c5608-b0ad-4c05-9dec-a53b072ef74c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:13.964617 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b8c5608-b0ad-4c05-9dec-a53b072ef74c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:13.965060 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b8c5608-b0ad-4c05-9dec-a53b072ef74c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:13.965815 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b8c5608-b0ad-4c05-9dec-a53b072ef74c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:13.966246 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-9b8c5608-b0ad-4c05-9dec-a53b072ef74c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:14.098952 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-9b8c5608-b0ad-4c05-9dec-a53b072ef74c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:14.106259 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-9b8c5608-b0ad-4c05-9dec-a53b072ef74c tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1267 microversion: 2.1 time: 0.153291 Jul 25 06:12:14.106812 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 602/1197] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:13 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:15.122955 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-b9d6ad38-8ff6-4301-a0bc-7b7211e16e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:15.123545 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-b9d6ad38-8ff6-4301-a0bc-7b7211e16e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:15.130032 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9d6ad38-8ff6-4301-a0bc-7b7211e16e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:15.130479 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9d6ad38-8ff6-4301-a0bc-7b7211e16e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:15.131231 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9d6ad38-8ff6-4301-a0bc-7b7211e16e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:15.131670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-b9d6ad38-8ff6-4301-a0bc-7b7211e16e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:15.267990 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-b9d6ad38-8ff6-4301-a0bc-7b7211e16e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:15.275685 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-b9d6ad38-8ff6-4301-a0bc-7b7211e16e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1267 microversion: 2.1 time: 0.156720 Jul 25 06:12:15.276270 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 596/1198] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:15 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:16.293289 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-04f472f0-f7f8-42b7-85f2-f6a174542fa6 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:16.294032 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-04f472f0-f7f8-42b7-85f2-f6a174542fa6 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:16.296438 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell0:SELECT=2 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:16.302077 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-04f472f0-f7f8-42b7-85f2-f6a174542fa6 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:16.302521 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-04f472f0-f7f8-42b7-85f2-f6a174542fa6 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:16.303288 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-04f472f0-f7f8-42b7-85f2-f6a174542fa6 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:16.303723 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-04f472f0-f7f8-42b7-85f2-f6a174542fa6 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:16.524808 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-04f472f0-f7f8-42b7-85f2-f6a174542fa6 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:16.532604 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-04f472f0-f7f8-42b7-85f2-f6a174542fa6 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1267 microversion: 2.1 time: 0.243107 Jul 25 06:12:16.533032 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 603/1199] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:16 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:17.211882 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-62e8e007-3602-4582-9ab6-54ccecb138f2 req-6ba10fbc-6ee1-4080-9366-d12c89ce91f2 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"name": "network-changed", "server_uuid": "1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b", "tag": "58a00c23-3e4e-4b24-9a79-d8fb739d245a"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:12:17.217702 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-ea15b239-75a4-4574-be5e-54c9a2133fc6 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2c7c0>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:17.218251 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ea15b239-75a4-4574-be5e-54c9a2133fc6 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:17.226753 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=2 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:17.229553 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-62e8e007-3602-4582-9ab6-54ccecb138f2 req-6ba10fbc-6ee1-4080-9366-d12c89ce91f2 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:17.230151 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-62e8e007-3602-4582-9ab6-54ccecb138f2 req-6ba10fbc-6ee1-4080-9366-d12c89ce91f2 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:17.233190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell0:SELECT=6 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:17.234952 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ea15b239-75a4-4574-be5e-54c9a2133fc6 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:17.235399 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ea15b239-75a4-4574-be5e-54c9a2133fc6 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:17.236190 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ea15b239-75a4-4574-be5e-54c9a2133fc6 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:17.236624 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-ea15b239-75a4-4574-be5e-54c9a2133fc6 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:17.262660 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-62e8e007-3602-4582-9ab6-54ccecb138f2 req-6ba10fbc-6ee1-4080-9366-d12c89ce91f2 service nova] Creating event network-changed:58a00c23-3e4e-4b24-9a79-d8fb739d245a for instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b on hv-cinder-84841 Jul 25 06:12:17.267886 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-62e8e007-3602-4582-9ab6-54ccecb138f2 req-6ba10fbc-6ee1-4080-9366-d12c89ce91f2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059599 Jul 25 06:12:17.268928 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 604/1200] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:12:17.278699 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-ea15b239-75a4-4574-be5e-54c9a2133fc6 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Going to try to terminate instance {{(pid=124917) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:12:17.550776 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-ea73a11f-3282-4836-a9f4-fcd2f608dd80 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:17.551642 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-ea73a11f-3282-4836-a9f4-fcd2f608dd80 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:17.558916 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea73a11f-3282-4836-a9f4-fcd2f608dd80 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:17.559627 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea73a11f-3282-4836-a9f4-fcd2f608dd80 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:17.560272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-ea15b239-75a4-4574-be5e-54c9a2133fc6 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "DELETE /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 204 len: 0 microversion: 2.1 time: 0.354392 Jul 25 06:12:17.560808 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea73a11f-3282-4836-a9f4-fcd2f608dd80 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:17.561120 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 597/1201] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:12:17 2022] DELETE /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 06:12:17.564841 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-ea73a11f-3282-4836-a9f4-fcd2f608dd80 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:17.572598 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-2a7b849e-0028-4018-a9df-fe5cfd99c3c4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:17.577206 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-2a7b849e-0028-4018-a9df-fe5cfd99c3c4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:17.583667 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2a7b849e-0028-4018-a9df-fe5cfd99c3c4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:17.584289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2a7b849e-0028-4018-a9df-fe5cfd99c3c4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:17.585374 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2a7b849e-0028-4018-a9df-fe5cfd99c3c4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:17.586110 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-2a7b849e-0028-4018-a9df-fe5cfd99c3c4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:17.715892 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-ea73a11f-3282-4836-a9f4-fcd2f608dd80 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:17.724535 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-ea73a11f-3282-4836-a9f4-fcd2f608dd80 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1267 microversion: 2.1 time: 0.178203 Jul 25 06:12:17.729244 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 605/1202] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:17 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:12:17.741355 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-2a7b849e-0028-4018-a9df-fe5cfd99c3c4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:17.748955 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-2a7b849e-0028-4018-a9df-fe5cfd99c3c4 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.181652 Jul 25 06:12:17.749735 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 598/1203] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:17 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:12:18.740772 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-7297ae2e-b394-4d25-b2f2-f6a2558d4a13 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:18.741515 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-7297ae2e-b394-4d25-b2f2-f6a2558d4a13 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:18.748009 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7297ae2e-b394-4d25-b2f2-f6a2558d4a13 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:18.748551 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7297ae2e-b394-4d25-b2f2-f6a2558d4a13 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:18.749389 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7297ae2e-b394-4d25-b2f2-f6a2558d4a13 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:18.750397 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-7297ae2e-b394-4d25-b2f2-f6a2558d4a13 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:18.766854 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-8220a06d-f621-4ff5-9551-6cfccdafce7e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:18.768267 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-8220a06d-f621-4ff5-9551-6cfccdafce7e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:18.778806 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8220a06d-f621-4ff5-9551-6cfccdafce7e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:18.779264 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8220a06d-f621-4ff5-9551-6cfccdafce7e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:18.780258 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8220a06d-f621-4ff5-9551-6cfccdafce7e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:18.780972 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-8220a06d-f621-4ff5-9551-6cfccdafce7e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:18.910834 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-7297ae2e-b394-4d25-b2f2-f6a2558d4a13 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:18.920204 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-7297ae2e-b394-4d25-b2f2-f6a2558d4a13 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1267 microversion: 2.1 time: 0.183469 Jul 25 06:12:18.921104 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 606/1204] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:18 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:18.927143 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-ab4ce8ec-f481-43ba-a86b-f2bdb7d49bf3 req-cb9b8f95-9d3b-482e-99c5-66416423496b service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "665b20d0-f0bc-4e21-9003-055d987a93ca", "name": "network-vif-plugged", "status": "completed", "tag": "1bd4b51c-54f5-4c0f-9d56-7ac19d08837f"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:12:18.935336 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-ab4ce8ec-f481-43ba-a86b-f2bdb7d49bf3 req-cb9b8f95-9d3b-482e-99c5-66416423496b service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:18.935773 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-ab4ce8ec-f481-43ba-a86b-f2bdb7d49bf3 req-cb9b8f95-9d3b-482e-99c5-66416423496b service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:18.948559 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-ab4ce8ec-f481-43ba-a86b-f2bdb7d49bf3 req-cb9b8f95-9d3b-482e-99c5-66416423496b service nova] Creating event network-vif-plugged:1bd4b51c-54f5-4c0f-9d56-7ac19d08837f for instance 665b20d0-f0bc-4e21-9003-055d987a93ca on hv-cinder-84841 Jul 25 06:12:18.953475 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-ab4ce8ec-f481-43ba-a86b-f2bdb7d49bf3 req-cb9b8f95-9d3b-482e-99c5-66416423496b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030828 Jul 25 06:12:18.954077 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 607/1205] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:12:18.962371 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-8220a06d-f621-4ff5-9551-6cfccdafce7e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:18.969972 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-8220a06d-f621-4ff5-9551-6cfccdafce7e tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1571 microversion: 2.1 time: 0.207118 Jul 25 06:12:18.970532 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 599/1206] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:18 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1571 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:12:19.737118 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [req-89eae1f9-e65d-475c-9cd8-e39e61f673a1 req-88fc0da9-6cd1-47c4-a605-1664f11986e5 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534086610>>, body: {"events": [{"server_uuid": "1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b", "name": "network-vif-deleted", "tag": "58a00c23-3e4e-4b24-9a79-d8fb739d245a"}]} {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:12:19.746465 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-89eae1f9-e65d-475c-9cd8-e39e61f673a1 req-88fc0da9-6cd1-47c4-a605-1664f11986e5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:19.747095 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [req-89eae1f9-e65d-475c-9cd8-e39e61f673a1 req-88fc0da9-6cd1-47c4-a605-1664f11986e5 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:19.759144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.compute.server_external_events [req-89eae1f9-e65d-475c-9cd8-e39e61f673a1 req-88fc0da9-6cd1-47c4-a605-1664f11986e5 service nova] Creating event network-vif-deleted:58a00c23-3e4e-4b24-9a79-d8fb739d245a for instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b on hv-cinder-84841 Jul 25 06:12:19.768889 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [req-89eae1f9-e65d-475c-9cd8-e39e61f673a1 req-88fc0da9-6cd1-47c4-a605-1664f11986e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030947 Jul 25 06:12:19.768889 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 608/1207] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:12:19.937386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-1b8aec22-b880-4b8b-b536-282de453d062 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:19.938028 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-1b8aec22-b880-4b8b-b536-282de453d062 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:19.944832 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1b8aec22-b880-4b8b-b536-282de453d062 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:19.945225 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1b8aec22-b880-4b8b-b536-282de453d062 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:19.945978 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1b8aec22-b880-4b8b-b536-282de453d062 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:19.946409 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-1b8aec22-b880-4b8b-b536-282de453d062 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:19.989406 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-be94d296-9510-4738-82fd-22b0b80ae24f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:19.990195 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-be94d296-9510-4738-82fd-22b0b80ae24f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:19.996523 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-be94d296-9510-4738-82fd-22b0b80ae24f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:19.997084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-be94d296-9510-4738-82fd-22b0b80ae24f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:19.998009 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-be94d296-9510-4738-82fd-22b0b80ae24f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:19.998378 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-be94d296-9510-4738-82fd-22b0b80ae24f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:20.087646 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-be94d296-9510-4738-82fd-22b0b80ae24f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:20.091564 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-1b8aec22-b880-4b8b-b536-282de453d062 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:20.092766 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-be94d296-9510-4738-82fd-22b0b80ae24f tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1220 microversion: 2.1 time: 0.108232 Jul 25 06:12:20.093347 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 609/1208] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:19 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:12:20.100193 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-1b8aec22-b880-4b8b-b536-282de453d062 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1267 microversion: 2.1 time: 0.166636 Jul 25 06:12:20.104143 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 600/1209] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:19 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:21.110535 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-d2889a82-2a10-4121-b37a-42f99d1afc04 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:21.111082 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-d2889a82-2a10-4121-b37a-42f99d1afc04 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:21.117670 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-331c0028-c651-41b1-a1e2-132e613d3e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:21.118282 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-331c0028-c651-41b1-a1e2-132e613d3e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:21.118438 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d2889a82-2a10-4121-b37a-42f99d1afc04 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:21.118902 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d2889a82-2a10-4121-b37a-42f99d1afc04 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:21.119643 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d2889a82-2a10-4121-b37a-42f99d1afc04 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:21.120076 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d2889a82-2a10-4121-b37a-42f99d1afc04 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:21.124689 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-331c0028-c651-41b1-a1e2-132e613d3e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:21.125134 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-331c0028-c651-41b1-a1e2-132e613d3e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:21.125893 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-331c0028-c651-41b1-a1e2-132e613d3e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:21.126326 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-331c0028-c651-41b1-a1e2-132e613d3e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:21.151069 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d2889a82-2a10-4121-b37a-42f99d1afc04 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:21.151501 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-d2889a82-2a10-4121-b37a-42f99d1afc04 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:21.151948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.objects.instance [None req-d2889a82-2a10-4121-b37a-42f99d1afc04 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lazy-loading 'fault' on Instance uuid 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b {{(pid=124918) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 06:12:21.192558 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-d2889a82-2a10-4121-b37a-42f99d1afc04 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eca908cd8a1481c9e4c11036cd4df7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520876da8974c439cef1b35397029f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:21.200190 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-d2889a82-2a10-4121-b37a-42f99d1afc04 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 200 len: 1225 microversion: 2.1 time: 0.093559 Jul 25 06:12:21.200965 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 610/1210] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:21 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:21.261590 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-331c0028-c651-41b1-a1e2-132e613d3e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:21.269342 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-331c0028-c651-41b1-a1e2-132e613d3e6b tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1453 microversion: 2.1 time: 0.156348 Jul 25 06:12:21.270439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 601/1211] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:21 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 06:12:21.287418 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-091e118d-d420-452e-afc6-d3d21e7bee08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:21.288017 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-091e118d-d420-452e-afc6-d3d21e7bee08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:21.293946 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-091e118d-d420-452e-afc6-d3d21e7bee08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:21.294390 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-091e118d-d420-452e-afc6-d3d21e7bee08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:21.295138 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-091e118d-d420-452e-afc6-d3d21e7bee08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:21.295568 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-091e118d-d420-452e-afc6-d3d21e7bee08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:21.433869 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-091e118d-d420-452e-afc6-d3d21e7bee08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:12:21.441341 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-091e118d-d420-452e-afc6-d3d21e7bee08 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1453 microversion: 2.1 time: 0.158497 Jul 25 06:12:21.442540 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 611/1212] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:21 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:12:22.217358 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0deafc27-e231-48b0-997e-5d9b978a68d8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:22.217991 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0deafc27-e231-48b0-997e-5d9b978a68d8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] [instance: 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:12:22.224935 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0deafc27-e231-48b0-997e-5d9b978a68d8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:22.225438 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0deafc27-e231-48b0-997e-5d9b978a68d8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:22.226394 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0deafc27-e231-48b0-997e-5d9b978a68d8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:22.226829 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0deafc27-e231-48b0-997e-5d9b978a68d8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:22.241278 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-0deafc27-e231-48b0-997e-5d9b978a68d8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] HTTP exception thrown: Instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b could not be found. Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0deafc27-e231-48b0-997e-5d9b978a68d8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Request method failure captured: Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b HTTP/1.1 Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jMcGRrdg1nWB2zaA90x5640cPEIXU-qRVAB3F_ylIkewH87zd5qLRyNaM6H1SVUTKoJECT5amLG8IrpFz4M5bZtIOn-EeasiD1vSLwsjh01SUnqUCXNrJxkFfFZFVdGUrofanTklps0i98kqYVC3zM9bu_rbqITADQ_L_EjBkDOSxQ Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: 3520876da8974c439cef1b35397029f9 Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-TestShelveInstance-1762520740 Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:12:22.243112 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/3520876da8974c439cef1b35397029f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3520876da8974c439cef1b35397029f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_3520876da8974c439cef1b35397029f9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/3520876da8974c439cef1b35397029f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-TestShelveInstance-1762520740 Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: 3520876da8974c439cef1b35397029f9 Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-TestShelveInstance-1762520740 Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-TestShelveInstance-1762520740-project Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 3eca908cd8a1481c9e4c11036cd4df7b Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-TestShelveInstance-1762520740-project Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b could not be found. Jul 25 06:12:22.244750 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': '1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b'} Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b could not be found. Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:12:22.245647 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b could not be found. Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b could not be found. Jul 25 06:12:22.247067 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:12:22.248544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0deafc27-e231-48b0-997e-5d9b978a68d8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Returning 404 to user: Instance 1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:12:22.248544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0deafc27-e231-48b0-997e-5d9b978a68d8 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b" status: 404 len: 111 microversion: 2.1 time: 0.031250 Jul 25 06:12:22.248544 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 602/1213] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:12:22 2022] GET /compute/v2.1/servers/1b55cd9b-6c1e-4e0e-8cd7-c939a7b5210b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:12:22.490602 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-1b79d224-b1da-42d4-ba27-e50bfee4a4d5 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531d8b820>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:12:22.606387 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-1b79d224-b1da-42d4-ba27-e50bfee4a4d5 tempest-TestShelveInstance-1762520740 tempest-TestShelveInstance-1762520740-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1968237889" status: 202 len: 0 microversion: 2.1 time: 0.119944 Jul 25 06:12:22.606975 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 612/1214] 10.222.0.40 () {58 vars in 1253 bytes} [Mon Jul 25 06:12:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1968237889 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:12:23.982512 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-9eac4d0f-5d81-4d69-a7cf-f3efd73922b5 req-7f2b2b60-9bed-48ea-b455-efd995557d32 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "665b20d0-f0bc-4e21-9003-055d987a93ca", "tag": "1bd4b51c-54f5-4c0f-9d56-7ac19d08837f"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:12:23.992424 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-9eac4d0f-5d81-4d69-a7cf-f3efd73922b5 req-7f2b2b60-9bed-48ea-b455-efd995557d32 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:12:23.993007 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-9eac4d0f-5d81-4d69-a7cf-f3efd73922b5 req-7f2b2b60-9bed-48ea-b455-efd995557d32 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:12:24.005480 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-9eac4d0f-5d81-4d69-a7cf-f3efd73922b5 req-7f2b2b60-9bed-48ea-b455-efd995557d32 service nova] Creating event network-changed:1bd4b51c-54f5-4c0f-9d56-7ac19d08837f for instance 665b20d0-f0bc-4e21-9003-055d987a93ca on hv-cinder-84841 Jul 25 06:12:24.011341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-9eac4d0f-5d81-4d69-a7cf-f3efd73922b5 req-7f2b2b60-9bed-48ea-b455-efd995557d32 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033591 Jul 25 06:12:24.012196 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 603/1215] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:13:53.072872 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_cell1:SELECT=64 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:53.074048 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG dbcounter [-] [124918] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=124918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:53.075485 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:53.076341 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG dbcounter [-] [124917] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:53.078883 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-829370e5-ec18-468f-98e6-8ced5b13c4c9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:13:53.079378 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-829370e5-ec18-468f-98e6-8ced5b13c4c9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:13:53.081272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-a7a7d6f1-e143-4ee7-b869-4454a7b6dbad req-8ff8fdfb-1507-4603-afb4-b0afe31fb181 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "665b20d0-f0bc-4e21-9003-055d987a93ca", "tag": "1bd4b51c-54f5-4c0f-9d56-7ac19d08837f"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:13:53.085902 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-829370e5-ec18-468f-98e6-8ced5b13c4c9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:53.086749 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-829370e5-ec18-468f-98e6-8ced5b13c4c9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:53.087107 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-829370e5-ec18-468f-98e6-8ced5b13c4c9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:53.087536 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-829370e5-ec18-468f-98e6-8ced5b13c4c9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:53.091017 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-a7a7d6f1-e143-4ee7-b869-4454a7b6dbad req-8ff8fdfb-1507-4603-afb4-b0afe31fb181 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:53.093232 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-a7a7d6f1-e143-4ee7-b869-4454a7b6dbad req-8ff8fdfb-1507-4603-afb4-b0afe31fb181 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:53.102888 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-a7a7d6f1-e143-4ee7-b869-4454a7b6dbad req-8ff8fdfb-1507-4603-afb4-b0afe31fb181 service nova] Creating event network-changed:1bd4b51c-54f5-4c0f-9d56-7ac19d08837f for instance 665b20d0-f0bc-4e21-9003-055d987a93ca on hv-cinder-84841 Jul 25 06:13:53.109151 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-a7a7d6f1-e143-4ee7-b869-4454a7b6dbad req-8ff8fdfb-1507-4603-afb4-b0afe31fb181 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036290 Jul 25 06:13:53.110096 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 604/1216] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:13:53.119548 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-829370e5-ec18-468f-98e6-8ced5b13c4c9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:13:53.411205 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-829370e5-ec18-468f-98e6-8ced5b13c4c9 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "DELETE /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 204 len: 0 microversion: 2.1 time: 0.340477 Jul 25 06:13:53.415701 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 613/1217] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:13:53 2022] DELETE /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:13:53.422698 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-95e72dfb-0a21-4a39-a890-8a4eea5a794d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:13:53.423467 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-95e72dfb-0a21-4a39-a890-8a4eea5a794d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:13:53.432048 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95e72dfb-0a21-4a39-a890-8a4eea5a794d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:53.432537 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95e72dfb-0a21-4a39-a890-8a4eea5a794d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:53.433393 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95e72dfb-0a21-4a39-a890-8a4eea5a794d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:53.433952 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-95e72dfb-0a21-4a39-a890-8a4eea5a794d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:53.575378 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-95e72dfb-0a21-4a39-a890-8a4eea5a794d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:13:53.582752 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-95e72dfb-0a21-4a39-a890-8a4eea5a794d tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1577 microversion: 2.1 time: 0.165491 Jul 25 06:13:53.587163 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 605/1218] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:13:53 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:13:54.602075 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-437a210f-abbc-4727-9947-5bf96f5e8753 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:13:54.602764 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-437a210f-abbc-4727-9947-5bf96f5e8753 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:13:54.609882 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-437a210f-abbc-4727-9947-5bf96f5e8753 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:54.610023 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-437a210f-abbc-4727-9947-5bf96f5e8753 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:54.610733 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-437a210f-abbc-4727-9947-5bf96f5e8753 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:54.611118 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-437a210f-abbc-4727-9947-5bf96f5e8753 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:54.744845 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-437a210f-abbc-4727-9947-5bf96f5e8753 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:13:54.753065 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-437a210f-abbc-4727-9947-5bf96f5e8753 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1577 microversion: 2.1 time: 0.155155 Jul 25 06:13:54.753598 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 614/1219] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:13:54 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:13:55.552688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-2001bf85-ef53-4420-a3a2-9ea265bfdd3b req-8152b277-1ae6-4978-8e65-bc1be7e2eb80 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "665b20d0-f0bc-4e21-9003-055d987a93ca", "name": "network-vif-deleted", "tag": "1bd4b51c-54f5-4c0f-9d56-7ac19d08837f"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:13:55.562116 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-2001bf85-ef53-4420-a3a2-9ea265bfdd3b req-8152b277-1ae6-4978-8e65-bc1be7e2eb80 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:55.562557 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-2001bf85-ef53-4420-a3a2-9ea265bfdd3b req-8152b277-1ae6-4978-8e65-bc1be7e2eb80 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:55.573659 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-2001bf85-ef53-4420-a3a2-9ea265bfdd3b req-8152b277-1ae6-4978-8e65-bc1be7e2eb80 service nova] Creating event network-vif-deleted:1bd4b51c-54f5-4c0f-9d56-7ac19d08837f for instance 665b20d0-f0bc-4e21-9003-055d987a93ca on hv-cinder-84841 Jul 25 06:13:55.578510 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-2001bf85-ef53-4420-a3a2-9ea265bfdd3b req-8152b277-1ae6-4978-8e65-bc1be7e2eb80 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030050 Jul 25 06:13:55.579095 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 606/1220] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:13:55.771730 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-49df5afe-943c-4ace-82ea-0a9c0b8a15df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:13:55.772369 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-49df5afe-943c-4ace-82ea-0a9c0b8a15df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:13:55.779490 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49df5afe-943c-4ace-82ea-0a9c0b8a15df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:55.779929 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49df5afe-943c-4ace-82ea-0a9c0b8a15df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:55.780713 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49df5afe-943c-4ace-82ea-0a9c0b8a15df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:55.781144 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-49df5afe-943c-4ace-82ea-0a9c0b8a15df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:55.842566 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-49df5afe-943c-4ace-82ea-0a9c0b8a15df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:13:55.850366 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-49df5afe-943c-4ace-82ea-0a9c0b8a15df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 200 len: 1226 microversion: 2.1 time: 0.082814 Jul 25 06:13:55.850949 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 615/1221] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:13:55 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:13:56.867776 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0980e20c-c0e6-4d69-8539-3c9989d17e66 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:13:56.868540 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-0980e20c-c0e6-4d69-8539-3c9989d17e66 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: 665b20d0-f0bc-4e21-9003-055d987a93ca] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:13:56.874958 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0980e20c-c0e6-4d69-8539-3c9989d17e66 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:56.875409 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0980e20c-c0e6-4d69-8539-3c9989d17e66 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:56.876185 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0980e20c-c0e6-4d69-8539-3c9989d17e66 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:13:56.876619 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-0980e20c-c0e6-4d69-8539-3c9989d17e66 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:13:56.889743 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-0980e20c-c0e6-4d69-8539-3c9989d17e66 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] HTTP exception thrown: Instance 665b20d0-f0bc-4e21-9003-055d987a93ca could not be found. Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0980e20c-c0e6-4d69-8539-3c9989d17e66 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Request method failure captured: Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca HTTP/1.1 Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jMBDiCp4qexhWETuF6YgbGWHx25oujjO-EQxNn7oOsltyIObOTEUEB6LEI2mokPkkR-T6YRdZVrrjxz32azqZu3DeKysUvPCk3mDw7B3pOwddrOmlfNBIAkhZ1Leny3CNhHRz-3QYHnfUNNmKOes1TjpyXtHZiEoRCB5y88YlLmrIM Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: d275686dbcfc44769065d5d9ba1a6f0c Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-TestVolumeBootPattern-27640003 Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:13:56.891334 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d275686dbcfc44769065d5d9ba1a6f0c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-TestVolumeBootPattern-27640003 Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: d275686dbcfc44769065d5d9ba1a6f0c Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-TestVolumeBootPattern-27640003 Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-TestVolumeBootPattern-27640003-project Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 86335999e9744e4c815a628607618b4f Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-TestVolumeBootPattern-27640003-project Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance 665b20d0-f0bc-4e21-9003-055d987a93ca could not be found. Jul 25 06:13:56.893156 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': '665b20d0-f0bc-4e21-9003-055d987a93ca'} Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 665b20d0-f0bc-4e21-9003-055d987a93ca could not be found. Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:13:56.894388 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 665b20d0-f0bc-4e21-9003-055d987a93ca could not be found. Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 665b20d0-f0bc-4e21-9003-055d987a93ca could not be found. Jul 25 06:13:56.896439 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:13:56.898043 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-0980e20c-c0e6-4d69-8539-3c9989d17e66 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Returning 404 to user: Instance 665b20d0-f0bc-4e21-9003-055d987a93ca could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:13:56.898043 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-0980e20c-c0e6-4d69-8539-3c9989d17e66 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca" status: 404 len: 111 microversion: 2.1 time: 0.029667 Jul 25 06:13:56.898043 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 607/1222] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:13:56 2022] GET /compute/v2.1/servers/665b20d0-f0bc-4e21-9003-055d987a93ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:14:00.433918 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-eea1bb50-b872-4ac4-a448-34034135aff1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:00.434438 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-eea1bb50-b872-4ac4-a448-34034135aff1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:00.436505 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-f5f843fa-2ada-40eb-bedd-967ecb423228 req-6962f269-0c01-499f-b556-6f5f28224dfc service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"name": "network-changed", "server_uuid": "c0bdb7c6-3cf4-4bf6-a67b-3cc406855567", "tag": "73cffae0-d1fe-401f-bf00-2a379c708385"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:14:00.442047 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-eea1bb50-b872-4ac4-a448-34034135aff1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:00.442578 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-eea1bb50-b872-4ac4-a448-34034135aff1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:00.443432 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-eea1bb50-b872-4ac4-a448-34034135aff1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:00.443948 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-eea1bb50-b872-4ac4-a448-34034135aff1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:00.445864 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-f5f843fa-2ada-40eb-bedd-967ecb423228 req-6962f269-0c01-499f-b556-6f5f28224dfc service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:00.446305 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-f5f843fa-2ada-40eb-bedd-967ecb423228 req-6962f269-0c01-499f-b556-6f5f28224dfc service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:00.457946 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-f5f843fa-2ada-40eb-bedd-967ecb423228 req-6962f269-0c01-499f-b556-6f5f28224dfc service nova] Creating event network-changed:73cffae0-d1fe-401f-bf00-2a379c708385 for instance c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 on hv-cinder-84841 Jul 25 06:14:00.463254 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-f5f843fa-2ada-40eb-bedd-967ecb423228 req-6962f269-0c01-499f-b556-6f5f28224dfc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031061 Jul 25 06:14:00.467552 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 608/1223] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:14:00.473879 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-eea1bb50-b872-4ac4-a448-34034135aff1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Going to try to terminate instance {{(pid=124918) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 06:14:00.747376 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-eea1bb50-b872-4ac4-a448-34034135aff1 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 204 len: 0 microversion: 2.1 time: 0.316761 Jul 25 06:14:00.748822 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 616/1224] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:14:00 2022] DELETE /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 06:14:00.757200 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-5aa87790-0ddd-40e9-8ffd-631576e1d7df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:00.758677 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-5aa87790-0ddd-40e9-8ffd-631576e1d7df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:00.773800 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5aa87790-0ddd-40e9-8ffd-631576e1d7df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:00.773800 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5aa87790-0ddd-40e9-8ffd-631576e1d7df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:00.773800 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5aa87790-0ddd-40e9-8ffd-631576e1d7df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:00.773800 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-5aa87790-0ddd-40e9-8ffd-631576e1d7df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:00.964438 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.policy [None req-5aa87790-0ddd-40e9-8ffd-631576e1d7df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124917) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:14:00.972822 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-5aa87790-0ddd-40e9-8ffd-631576e1d7df tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1577 microversion: 2.1 time: 0.219778 Jul 25 06:14:00.973408 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 609/1225] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:00 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:14:01.991285 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-3b0667f7-02e9-4703-9e94-88472af3be8f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:01.991983 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-3b0667f7-02e9-4703-9e94-88472af3be8f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:01.999297 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3b0667f7-02e9-4703-9e94-88472af3be8f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:01.999744 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3b0667f7-02e9-4703-9e94-88472af3be8f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:02.000529 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3b0667f7-02e9-4703-9e94-88472af3be8f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:02.000968 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-3b0667f7-02e9-4703-9e94-88472af3be8f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:02.137483 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-3b0667f7-02e9-4703-9e94-88472af3be8f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:14:02.145142 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-3b0667f7-02e9-4703-9e94-88472af3be8f tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1459 microversion: 2.1 time: 0.158119 Jul 25 06:14:02.145961 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 617/1226] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:01 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1459 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:14:02.721551 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [req-4543023a-f485-4fc9-bb16-b130541bf413 req-81b422ac-2cfd-4bfb-8c83-a0a489470149 service nova] Action: 'create', calling method: <bound method ServerExternalEventsController.create of <nova.api.openstack.compute.server_external_events.ServerExternalEventsController object at 0x7f6534087640>>, body: {"events": [{"server_uuid": "c0bdb7c6-3cf4-4bf6-a67b-3cc406855567", "name": "network-vif-deleted", "tag": "73cffae0-d1fe-401f-bf00-2a379c708385"}]} {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 06:14:02.730040 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-4543023a-f485-4fc9-bb16-b130541bf413 req-81b422ac-2cfd-4bfb-8c83-a0a489470149 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:02.736908 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [req-4543023a-f485-4fc9-bb16-b130541bf413 req-81b422ac-2cfd-4bfb-8c83-a0a489470149 service nova] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:02.741426 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.compute.server_external_events [req-4543023a-f485-4fc9-bb16-b130541bf413 req-81b422ac-2cfd-4bfb-8c83-a0a489470149 service nova] Creating event network-vif-deleted:73cffae0-d1fe-401f-bf00-2a379c708385 for instance c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 on hv-cinder-84841 Jul 25 06:14:02.746318 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [req-4543023a-f485-4fc9-bb16-b130541bf413 req-81b422ac-2cfd-4bfb-8c83-a0a489470149 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028951 Jul 25 06:14:02.746906 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 610/1227] 10.222.0.40 () {64 vars in 1317 bytes} [Mon Jul 25 06:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 06:14:03.162728 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-8234f7bf-f448-46f1-b1d0-82a1b4d50c84 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7d160>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:03.166084 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-8234f7bf-f448-46f1-b1d0-82a1b4d50c84 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:03.170485 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8234f7bf-f448-46f1-b1d0-82a1b4d50c84 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:03.170930 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8234f7bf-f448-46f1-b1d0-82a1b4d50c84 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:03.171685 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8234f7bf-f448-46f1-b1d0-82a1b4d50c84 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:03.172136 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-8234f7bf-f448-46f1-b1d0-82a1b4d50c84 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:03.235726 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.policy [None req-8234f7bf-f448-46f1-b1d0-82a1b4d50c84 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86335999e9744e4c815a628607618b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd275686dbcfc44769065d5d9ba1a6f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124918) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 06:14:03.243588 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-8234f7bf-f448-46f1-b1d0-82a1b4d50c84 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 200 len: 1226 microversion: 2.1 time: 0.084657 Jul 25 06:14:03.244102 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 618/1228] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:03 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 06:14:04.262780 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-aabbbeed-91d3-4db0-b604-1f3ca0a9fa21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:04.264263 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-aabbbeed-91d3-4db0-b604-1f3ca0a9fa21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: c0bdb7c6-3cf4-4bf6-a67b-3cc406855567] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:04.270941 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-aabbbeed-91d3-4db0-b604-1f3ca0a9fa21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:04.272493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-aabbbeed-91d3-4db0-b604-1f3ca0a9fa21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:04.272493 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-aabbbeed-91d3-4db0-b604-1f3ca0a9fa21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:04.272711 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-aabbbeed-91d3-4db0-b604-1f3ca0a9fa21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:04.286282 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-aabbbeed-91d3-4db0-b604-1f3ca0a9fa21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] HTTP exception thrown: Instance c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 could not be found. Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-aabbbeed-91d3-4db0-b604-1f3ca0a9fa21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Request method failure captured: Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 HTTP/1.1 Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jMBDiCp4qexhWETuF6YgbGWHx25oujjO-EQxNn7oOsltyIObOTEUEB6LEI2mokPkkR-T6YRdZVrrjxz32azqZu3DeKysUvPCk3mDw7B3pOwddrOmlfNBIAkhZ1Leny3CNhHRz-3QYHnfUNNmKOes1TjpyXtHZiEoRCB5y88YlLmrIM Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: d275686dbcfc44769065d5d9ba1a6f0c Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-TestVolumeBootPattern-27640003 Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:14:04.287919 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d275686dbcfc44769065d5d9ba1a6f0c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-TestVolumeBootPattern-27640003 Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: d275686dbcfc44769065d5d9ba1a6f0c Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-TestVolumeBootPattern-27640003 Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-TestVolumeBootPattern-27640003-project Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 86335999e9744e4c815a628607618b4f Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-TestVolumeBootPattern-27640003-project Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 could not be found. Jul 25 06:14:04.289688 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'c0bdb7c6-3cf4-4bf6-a67b-3cc406855567'} Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 could not be found. Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:14:04.290672 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 could not be found. Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 could not be found. Jul 25 06:14:04.292386 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.293977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-aabbbeed-91d3-4db0-b604-1f3ca0a9fa21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Returning 404 to user: Instance c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:14:04.293977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-aabbbeed-91d3-4db0-b604-1f3ca0a9fa21 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567" status: 404 len: 111 microversion: 2.1 time: 0.031675 Jul 25 06:14:04.293977 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 611/1229] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:04 2022] GET /compute/v2.1/servers/c0bdb7c6-3cf4-4bf6-a67b-3cc406855567 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:14:04.813500 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fe59b393-abc1-4ae2-8bb6-83417dbf1bdf tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:04.814018 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.compute.api [None req-fe59b393-abc1-4ae2-8bb6-83417dbf1bdf tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124918) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:04.820185 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fe59b393-abc1-4ae2-8bb6-83417dbf1bdf tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:04.820628 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fe59b393-abc1-4ae2-8bb6-83417dbf1bdf tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:04.821542 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fe59b393-abc1-4ae2-8bb6-83417dbf1bdf tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:04.821976 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG oslo_concurrency.lockutils [None req-fe59b393-abc1-4ae2-8bb6-83417dbf1bdf tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:04.835340 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.wsgi [None req-fe59b393-abc1-4ae2-8bb6-83417dbf1bdf tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] HTTP exception thrown: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fe59b393-abc1-4ae2-8bb6-83417dbf1bdf tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Request method failure captured: Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: request: DELETE /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 HTTP/1.1 Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept: application/json Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Accept-Encoding: identity Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Connection: close Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Length: 0 Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Content-Type: application/json Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Host: 10.222.0.40 Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Openstack-System-Scope: None Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: User-Agent: python-urllib3/1.26.9 Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Auth-Token: gAAAAABi3jMBDiCp4qexhWETuF6YgbGWHx25oujjO-EQxNn7oOsltyIObOTEUEB6LEI2mokPkkR-T6YRdZVrrjxz32azqZu3DeKysUvPCk3mDw7B3pOwddrOmlfNBIAkhZ1Leny3CNhHRz-3QYHnfUNNmKOes1TjpyXtHZiEoRCB5y88YlLmrIM Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Id: None Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Domain-Name: None Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Identity-Status: Confirmed Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Is-Admin-Project: True Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Id: default Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Domain-Name: Default Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Id: d275686dbcfc44769065d5d9ba1a6f0c Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Project-Name: tempest-TestVolumeBootPattern-27640003 Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Role: member,reader Jul 25 06:14:04.836999 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Roles: member,reader Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d275686dbcfc44769065d5d9ba1a6f0c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant: tempest-TestVolumeBootPattern-27640003 Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Id: d275686dbcfc44769065d5d9ba1a6f0c Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-Tenant-Name: tempest-TestVolumeBootPattern-27640003 Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User: tempest-TestVolumeBootPattern-27640003-project Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Id: default Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Domain-Name: Default Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Id: 86335999e9744e4c815a628607618b4f Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: X-User-Name: tempest-TestVolumeBootPattern-27640003-project Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: method: <bound method ServersController.delete of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f2b790>> Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: exception: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:14:04.838698 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: action_args: {'id': 'dd545b80-aca7-4c39-a8ed-fcfc420bcdc0'} Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:14:04.839680 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:14:04.841305 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.843803 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fe59b393-abc1-4ae2-8bb6-83417dbf1bdf tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Returning 404 to user: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. {{(pid=124918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:14:04.843803 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-fe59b393-abc1-4ae2-8bb6-83417dbf1bdf tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "DELETE /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 404 len: 111 microversion: 2.1 time: 0.029400 Jul 25 06:14:04.843803 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 619/1230] 10.222.0.40 () {58 vars in 1238 bytes} [Mon Jul 25 06:14:04 2022] DELETE /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:14:04.847613 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-866a9c42-32ce-41bf-a6c9-8e5f1bbc19fb tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>>' {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:04.848272 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.compute.api [None req-866a9c42-32ce-41bf-a6c9-8e5f1bbc19fb tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] [instance: dd545b80-aca7-4c39-a8ed-fcfc420bcdc0] Fetching instance by UUID {{(pid=124917) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 06:14:04.854185 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-866a9c42-32ce-41bf-a6c9-8e5f1bbc19fb tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:04.854631 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-866a9c42-32ce-41bf-a6c9-8e5f1bbc19fb tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:04.855385 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-866a9c42-32ce-41bf-a6c9-8e5f1bbc19fb tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" acquired by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 06:14:04.855820 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG oslo_concurrency.lockutils [None req-866a9c42-32ce-41bf-a6c9-8e5f1bbc19fb tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Lock "cd564ae1-4e01-4f80-b362-1614dcc559db" "released" by "nova.context.set_target_cell.<locals>.get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124917) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 06:14:04.868803 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.wsgi [None req-866a9c42-32ce-41bf-a6c9-8e5f1bbc19fb tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] HTTP exception thrown: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-866a9c42-32ce-41bf-a6c9-8e5f1bbc19fb tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Request method failure captured: Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: request: GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 HTTP/1.1 Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept: application/json Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Accept-Encoding: identity Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Connection: close Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Length: 0 Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Content-Type: application/json Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Host: 10.222.0.40 Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Openstack-System-Scope: None Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: User-Agent: python-urllib3/1.26.9 Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Auth-Token: gAAAAABi3jMBDiCp4qexhWETuF6YgbGWHx25oujjO-EQxNn7oOsltyIObOTEUEB6LEI2mokPkkR-T6YRdZVrrjxz32azqZu3DeKysUvPCk3mDw7B3pOwddrOmlfNBIAkhZ1Leny3CNhHRz-3QYHnfUNNmKOes1TjpyXtHZiEoRCB5y88YlLmrIM Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Id: None Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Domain-Name: None Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Identity-Status: Confirmed Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Is-Admin-Project: True Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Id: default Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Domain-Name: Default Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Id: d275686dbcfc44769065d5d9ba1a6f0c Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Project-Name: tempest-TestVolumeBootPattern-27640003 Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Role: member,reader Jul 25 06:14:04.870246 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Roles: member,reader Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d275686dbcfc44769065d5d9ba1a6f0c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d275686dbcfc44769065d5d9ba1a6f0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant: tempest-TestVolumeBootPattern-27640003 Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Id: d275686dbcfc44769065d5d9ba1a6f0c Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-Tenant-Name: tempest-TestVolumeBootPattern-27640003 Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User: tempest-TestVolumeBootPattern-27640003-project Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Id: default Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Domain-Name: Default Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Id: 86335999e9744e4c815a628607618b4f Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: X-User-Name: tempest-TestVolumeBootPattern-27640003-project Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: method: <bound method ServersController.show of <nova.api.openstack.compute.servers.ServersController object at 0x7f6533f7e190>> Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: exception: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:14:04.872036 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: action_args: {'id': 'dd545b80-aca7-4c39-a8ed-fcfc420bcdc0'} Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: {{(pid=124917) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 06:14:04.874008 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. Jul 25 06:14:04.875614 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: ERROR nova.api.openstack.wsgi Jul 25 06:14:04.877104 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: DEBUG nova.api.openstack.wsgi [None req-866a9c42-32ce-41bf-a6c9-8e5f1bbc19fb tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Returning 404 to user: Instance dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 could not be found. {{(pid=124917) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 06:14:04.877104 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO nova.api.openstack.requestlog [None req-866a9c42-32ce-41bf-a6c9-8e5f1bbc19fb tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0" status: 404 len: 111 microversion: 2.1 time: 0.027875 Jul 25 06:14:04.877104 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: [pid: 124917|app: 0|req: 612/1231] 10.222.0.40 () {58 vars in 1235 bytes} [Mon Jul 25 06:14:04 2022] GET /compute/v2.1/servers/dd545b80-aca7-4c39-a8ed-fcfc420bcdc0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 06:14:06.414213 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: DEBUG nova.api.openstack.wsgi [None req-fdd76614-2c21-4602-b284-fc05a9a9d6a5 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] Calling method '<function Controller.__getattribute__.<locals>.version_select at 0x7f6531f18700>' {{(pid=124918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 06:14:06.478865 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO nova.api.openstack.requestlog [None req-fdd76614-2c21-4602-b284-fc05a9a9d6a5 tempest-TestVolumeBootPattern-27640003 tempest-TestVolumeBootPattern-27640003-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1193999269" status: 202 len: 0 microversion: 2.1 time: 0.068480 Jul 25 06:14:06.479442 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: [pid: 124918|app: 0|req: 620/1232] 10.222.0.40 () {58 vars in 1262 bytes} [Mon Jul 25 06:14:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1193999269 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 06:14:41.232289 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:14:41.238987 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Mon Jul 25 06:14:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:14:47.140086 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:14:47.140640 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Mon Jul 25 06:14:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:16:27.385146 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:16:27.385671 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Mon Jul 25 06:16:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:17:04.378387 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:17:04.378994 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Mon Jul 25 06:17:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:17:32.676348 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:17:32.676942 dv-cinder-848418-2-iscsi devstack@n-api.service[124917]: Mon Jul 25 06:17:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 06:17:34.833543 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 06:17:34.834082 dv-cinder-848418-2-iscsi devstack@n-api.service[124918]: Mon Jul 25 06:17:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!